-- Logs begin at Wed 2022-06-22 15:47:37 UTC, end at Wed 2022-06-22 17:29:59 UTC. -- Jun 22 16:50:07.720365 dv-cinder-810457-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 16:50:07.729085 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 16:50:07 2022] *** Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: nodename: dv-cinder-810457-10-iscsi Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: machine: x86_64 Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: clock source: unix Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: pcre jit disabled Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: detected number of CPU cores: 4 Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: current working directory: / Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: detected binary path: /usr/bin/uwsgi-core Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: your processes number limit is 47680 Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: your memory page size is 4096 bytes Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: detected max file descriptor number: 2048 Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: lock engine: pthread robust mutexes Jun 22 16:50:07.731412 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: thunder lock: enabled Jun 22 16:50:07.732300 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 16:50:07.732300 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 16:50:07.776212 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: Python main interpreter initialized at 0x55f415e929c0 Jun 22 16:50:07.776212 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: python threads support enabled Jun 22 16:50:07.776212 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: your server socket listen backlog is limited to 100 connections Jun 22 16:50:07.776212 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: your mercy for graceful operations on workers is 90 seconds Jun 22 16:50:07.776566 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 16:50:07.776641 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: *** Operational MODE: preforking *** Jun 22 16:50:07.776872 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: *** uWSGI is running in multiple interpreter mode *** Jun 22 16:50:07.776872 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: spawned uWSGI master process (pid: 103730) Jun 22 16:50:07.777069 dv-cinder-810457-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 16:50:07.777613 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: spawned uWSGI worker 1 (pid: 103731, cores: 1) Jun 22 16:50:07.779399 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: spawned uWSGI worker 2 (pid: 103732, cores: 1) Jun 22 16:50:07.779399 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 16:50:08.430800 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 16:50:08.431398 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 16:50:09.556903 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:50:09.556903 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: from cryptography.utils import int_from_bytes Jun 22 16:50:09.557491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:50:09.557491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: from cryptography.utils import int_from_bytes Jun 22 16:50:09.560265 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:50:09.560265 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: from cryptography.utils import int_from_bytes Jun 22 16:50:09.560681 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:50:09.560681 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: from cryptography.utils import int_from_bytes Jun 22 16:50:12.014873 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 16:50:12.015408 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 16:50:12.015648 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 16:50:12.016009 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 16:50:12.016164 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 16:50:12.016512 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 16:50:12.016595 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 16:50:12.016688 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.016942 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 16:50:12.017038 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.017277 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.017370 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 16:50:12.017548 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 16:50:12.017643 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.017907 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.017996 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.018216 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.018308 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.018535 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.018621 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.018853 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.018945 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.019179 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.019271 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.019438 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.019532 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.022170 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.022322 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.022451 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810457-10-iscsi {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.022614 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023006 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023128 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023241 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023346 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023456 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023570 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023674 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023784 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810457-10-iscsi {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023888 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.023991 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.024121 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.024245 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.024367 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.024477 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.024477 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.024710 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.024865 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.024987 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.025117 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.025247 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.025377 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.025512 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.025631 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.025761 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.025888 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026008 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026127 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026257 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026377 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026502 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026623 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026741 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026865 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.026998 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.027122 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.027242 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.027363 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.027490 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810457-10-iscsi {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.027619 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.027738 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.027895 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.028009 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.028187 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.028321 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.028443 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810457-10-iscsi {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.028563 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.028699 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.028812 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.028930 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.029591 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.029726 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.029933 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.030071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.030205 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.030335 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.030468 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.030590 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.030710 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.030836 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.030958 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.031079 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.031208 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.031330 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.031451 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.031571 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.031691 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.031824 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.031946 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.032072 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.032227 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.032350 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.032478 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.032617 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.032739 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.032874 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.032996 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.033116 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.033236 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.033365 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.033486 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.033608 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.033727 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.033848 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.033982 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.034105 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.034226 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.034349 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.034470 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.034470 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.034788 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.034920 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.035046 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.035167 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.035278 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.035278 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.035527 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.035658 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.036324 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.036447 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.036578 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.036711 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.036834 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.036954 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.037082 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.037203 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.037332 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.037454 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.037574 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.037704 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.037839 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.037967 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.038101 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.038229 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.038351 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.038540 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.038666 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.038847 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.038981 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.039169 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.039293 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.039484 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.039616 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.039805 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.039963 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.040125 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.040263 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.040451 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.040578 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.040796 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.040929 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.041085 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.041220 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.041395 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.041526 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.041713 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.041837 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.042018 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.042151 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.042324 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.042448 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.042627 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.042753 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.042944 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.043076 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.043248 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.043371 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.043556 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.043681 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.043802 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.043921 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.044088 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.044227 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.044411 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.044537 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.044727 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.044859 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.045033 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.045167 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.045331 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.045460 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.045634 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.045765 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.045933 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.046071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.046237 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.046369 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.046539 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.046669 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.046840 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.046972 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.047138 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.047269 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.047438 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.047567 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.047740 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.047873 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.048044 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.048196 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.048371 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.048493 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.048674 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.048810 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.048979 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.049103 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.049285 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.049416 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.049590 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.049723 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.049891 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.050013 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.050194 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.050327 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.050496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.050623 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.050809 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.050932 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.051110 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.051233 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.051491 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.052146 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.052312 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.052440 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.052626 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.052749 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.052931 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.053055 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.053238 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.053363 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.053543 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.053672 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.053848 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.053973 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.054150 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.054272 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.054450 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.054574 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.054755 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.054880 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.055058 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.055182 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.055361 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.055484 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.055665 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.055789 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.055964 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.056086 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.056292 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.056430 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.056595 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.056721 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.056897 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.057021 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.057197 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.057333 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.057498 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.057621 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.057792 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.057916 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.058094 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.058226 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.058395 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.058520 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.058698 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.058822 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.058997 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.059138 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.059298 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.059422 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.059618 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.059755 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.059922 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.060055 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.060256 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.060381 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.060564 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.060697 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.060881 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:50:12.061007 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.061217 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.061342 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.061550 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.061674 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.061878 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.062003 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.062165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.062301 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.062477 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.062601 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.062799 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.062933 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.063111 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.063237 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.063421 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.063554 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.063730 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.063867 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.064044 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.064187 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.064381 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.064510 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.064696 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.064820 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.065007 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.065152 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.065324 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.065456 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.065637 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.065760 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.065947 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.066074 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.066261 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.066395 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.066578 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.066701 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.066895 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.067504 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.067718 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.067852 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.068036 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.068181 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.068391 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.068529 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.068715 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.068851 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.069028 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.069153 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.069344 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.069475 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.069659 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.069785 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.069968 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.070093 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.070276 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.070402 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.070596 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.070723 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.070923 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.071047 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.071231 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.071358 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.071543 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.071667 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.071847 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.071971 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.072179 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.072321 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.072490 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.072616 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.072797 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.072929 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.073104 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.073252 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.073415 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.073538 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.073726 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.073851 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.074036 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.074169 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.074345 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.074477 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.074658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.074782 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.074967 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.075101 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.075274 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.075418 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.075580 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.075705 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.075879 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.076017 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.076202 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.076329 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.076506 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.076632 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.076814 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.076952 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.077114 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.077238 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.077415 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.077539 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.077721 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.077847 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.078032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.078164 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.078337 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.078461 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.078646 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.078771 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.078953 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.079078 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.079260 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.079384 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.079571 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.079691 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.079872 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.079996 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.080204 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.080344 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.080511 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.080638 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.080813 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.080938 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.081118 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.081253 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.081428 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.081552 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.081730 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.081864 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.082033 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.082165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.082336 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.082471 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.083159 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.083294 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.083485 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.083620 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.083796 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.083930 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.084116 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.084243 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.084432 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.084570 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.084739 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.084863 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.085050 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.085174 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.085377 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.085502 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.085654 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.085779 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.085966 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.086091 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.086290 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.086428 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.086593 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.086717 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.086905 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.087029 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.087230 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.087354 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.087546 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.087672 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.087849 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.087974 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.088182 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.088322 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.088488 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.088621 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.088791 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.088925 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.089093 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.089219 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.089401 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.089523 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.089707 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.089844 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.090009 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.090139 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.090314 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.090437 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.090614 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.090747 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.090916 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.091039 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.091221 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.091347 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.091528 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.091665 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.091829 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.091953 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.092147 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.092275 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.092451 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.092584 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.092768 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.092892 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.093073 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.093197 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.093377 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.093503 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.093681 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.093818 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.094022 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.094147 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.094329 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.094466 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.094643 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.094766 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.094960 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.095085 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.095273 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.095399 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.095582 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.095714 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.095890 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.096024 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.096234 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.096367 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.096549 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.096674 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.096863 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.097002 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.097175 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.097299 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.097486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.097612 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.097806 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.097939 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.098113 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.098252 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.098457 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.098583 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.098760 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.098897 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.099079 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.099211 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.099389 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.099519 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.099710 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.099836 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.100020 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.100224 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.100348 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.100481 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.100671 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.100795 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.100986 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.101111 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.101296 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.101421 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.101604 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.101731 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.101912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.102037 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.102221 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.102353 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.102530 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.102654 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.102838 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.102969 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.103148 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.103272 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.103455 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.103587 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.103773 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.103897 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.104079 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.104251 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.104419 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.104536 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.104721 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.104854 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.105035 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.105175 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.105344 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.105467 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.105664 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.105789 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.105969 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.106102 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.106278 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.106408 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.106597 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.106735 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.106908 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.107042 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.107216 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.107341 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.107526 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.107649 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.107828 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.107959 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.108147 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.108287 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.108460 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.108576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.108769 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.108893 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.109076 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.109200 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.109377 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.109500 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.109684 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.109808 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.109996 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.110112 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.110303 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.110425 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.110606 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.110731 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.110907 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.111030 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.111212 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.111345 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.111518 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.111654 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.111815 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.111938 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.112152 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.112294 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.112448 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.112581 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.112757 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.112887 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.113061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.113194 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.113380 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.113505 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.113688 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.114338 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.114522 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.114729 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.114861 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.114982 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.115104 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.115225 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.115430 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.115563 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.115737 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.115862 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.116037 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.116180 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.116367 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.116494 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.116687 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.116819 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.116997 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.117123 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.117309 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.117435 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.117616 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.117740 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.117924 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.118049 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.118240 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.118364 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.118551 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.118667 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.118860 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.118985 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.119169 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.119295 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.119477 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.119603 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.119787 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.119921 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.120095 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.120276 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.120429 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.120553 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.120736 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.120868 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.121044 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.121178 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.121352 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.121478 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.121654 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.121794 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.121962 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.122087 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.122269 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.122400 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.122581 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.122835 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.122962 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.123169 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.123294 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.123486 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.123620 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.123806 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.124045 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.124188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.124404 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.124529 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.124723 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.124859 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.125048 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.125174 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.125371 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.125496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.125692 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.125831 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.126015 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.126150 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.126322 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.126447 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.126625 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.126762 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.126938 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.127077 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.127243 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.127376 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.127548 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.127675 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.127853 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.128005 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.128187 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.128313 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.128488 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.128623 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.128792 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.128919 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.129096 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.129229 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.129401 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.129557 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.130255 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.130381 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.130561 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.130685 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.130868 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.131000 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.131170 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.131294 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.131609 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.131792 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.131925 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.132096 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.132256 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.132419 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.132545 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.132723 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.132857 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.133040 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.133164 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.133345 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.133471 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.133651 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.133786 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.133956 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.134088 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.134301 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.134427 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.134610 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.134736 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.134912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.135037 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.135236 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.135362 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.135539 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.135665 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.135840 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.135965 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.136162 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.136290 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.136474 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.136601 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.136781 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.136906 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.137082 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.137217 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.137392 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.137519 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.137695 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.137819 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.138002 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.138136 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.138303 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.138436 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.138600 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.138731 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.138907 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.139108 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.139232 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.139354 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.139507 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.139632 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.139807 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.139940 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.140120 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.140246 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.140425 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.140543 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.140734 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.140869 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.141042 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.141168 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.141344 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.141467 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.141649 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.141784 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.141946 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.142069 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.142256 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.142387 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.142557 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.142683 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.142858 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.142984 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.143158 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.143284 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.143466 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.143599 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.143769 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.143893 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.144065 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.144227 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.144403 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.144539 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.144714 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.144847 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.145014 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.145167 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.145337 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.145462 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.145644 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.145787 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.145946 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.146080 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.146244 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.146369 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.146538 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.146662 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.146849 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.146983 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.147153 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.147278 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.147454 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.147578 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.148013 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.148189 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.148340 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.148465 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.148645 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.148771 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.148949 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.149105 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.149259 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.149383 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.149560 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.149684 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.149864 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.149998 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.150165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.150289 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.150472 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.150605 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.150773 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.150897 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.151078 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.151211 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.151383 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.151517 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.151684 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.151807 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.151988 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.152137 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.152317 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.152456 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.152633 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.152757 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.152941 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.153066 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.153247 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.153382 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.153553 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.153678 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.153887 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.154011 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.154198 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.154331 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.154512 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.154636 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.154820 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.154947 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.155134 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.155260 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.155436 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.155562 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.155752 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.155877 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.156062 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.156234 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.156400 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.156523 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.156704 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.156826 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.157005 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.157129 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.157322 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.157445 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.157629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.157751 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.157931 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.158054 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.158238 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.158363 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.158555 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.158677 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.158865 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.158988 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.159167 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.159298 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.159476 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.159614 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.159787 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.159911 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.160096 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.160244 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.160428 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.160557 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.160765 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.160891 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.161081 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.161212 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.161392 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.161525 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.161699 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.161821 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.162008 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.162137 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.162315 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.162452 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.162620 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.162744 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.162927 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.163048 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.163234 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.163364 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.163538 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.163662 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.163842 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.163963 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.164173 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.164301 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.164481 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.164614 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.164784 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.164906 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.165083 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.165206 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.165391 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.165515 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.165692 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.165823 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.165999 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.166121 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.166303 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.166427 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.166613 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.166750 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.166918 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.167041 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.167284 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.167406 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.167593 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.167798 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.167930 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.168052 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.168226 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.168351 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.168529 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.168666 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.168845 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.168968 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.169162 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.169293 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.169477 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.169609 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.169780 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.169905 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.170113 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.170236 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.170413 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.170538 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.170719 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.170837 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.171040 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.171163 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.171341 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.171465 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.171642 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.171777 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.171944 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.172069 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.172289 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.172416 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.172592 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.172717 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.172894 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.173021 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.173196 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.173329 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.173517 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.173642 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.173822 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.173956 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.174141 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.174289 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.174554 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.174680 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.174865 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.175004 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.175169 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.175301 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.175517 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.175651 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.175844 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.175978 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.176171 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.176825 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.177020 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.177157 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.177330 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.177481 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.177655 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.177795 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.177958 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.178083 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.178273 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.178405 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.178582 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.178820 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.178947 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.179068 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.179199 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.179332 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.179496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.179623 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.179810 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.179936 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.180156 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.180286 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.180459 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.180587 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.180789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.180923 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.181104 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.181230 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.181427 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.181563 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.181764 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.181889 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.182069 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.182203 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.182370 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.182506 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.182680 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.182807 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.182984 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.183118 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.183288 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.183414 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.183608 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.183746 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.183912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.184046 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.184246 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.184373 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.184553 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.184678 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.184858 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.184996 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.185162 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.185295 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.185465 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.185592 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.185773 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.185906 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.186076 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.186201 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.186380 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.186517 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.186686 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.186813 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.187005 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.187129 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.187309 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.187433 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.187617 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.187750 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.187935 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.188059 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.188266 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.188402 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.188570 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.188697 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.188873 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.188999 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.189176 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.189309 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.189491 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.189616 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.189797 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.189923 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.190104 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.190238 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.190407 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.190540 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.190739 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.190864 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.191048 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.191186 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.191369 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.191500 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.191693 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.191817 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.192561 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.192710 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.192888 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.193017 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.193213 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.193339 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.193515 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.193655 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.193817 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.193951 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.194126 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.194252 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.194428 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.194556 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.194735 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.194869 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.195035 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.195163 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.195342 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.195469 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.195641 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.195768 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.195943 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.196069 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.196269 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.196395 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.196581 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.196708 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.196880 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.197004 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.197182 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.197308 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.197486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.197611 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.197785 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.197918 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.198088 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.198215 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.198387 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.198512 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.198706 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.198839 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.199011 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.199138 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.199317 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.199443 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.199620 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.199758 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.199942 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.200066 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.200281 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.200417 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.200592 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.200726 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.200912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.201032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.201227 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.201354 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.201539 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.201673 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.201852 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.201976 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.202162 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.202286 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.202475 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.202602 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.202787 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.202926 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.203098 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.203231 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.203408 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.203543 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.203720 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.203844 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.204030 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.204200 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.204367 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.204494 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.204679 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.204884 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.205004 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.205211 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.205338 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.205525 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.205652 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.205837 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.206106 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.206245 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.206434 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.206568 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.206744 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.206877 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.207055 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.207197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.207365 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.207488 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.207696 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.207822 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.208006 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.208230 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.208357 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.208478 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.208637 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.208765 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.208950 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.209078 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.209262 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.209389 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.209593 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.209720 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.209906 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.210031 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.210221 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.210354 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.210533 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.210668 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.210865 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.210989 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.211183 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.211308 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.211485 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.211618 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.211798 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.211925 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.212147 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.212277 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.212445 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.212572 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.212756 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.212883 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.213065 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.213202 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.213377 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.213503 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.213686 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.213812 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.213996 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.214128 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.214302 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.214428 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.214614 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.214745 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.214925 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.215059 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.215234 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.215358 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.215546 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.215672 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.215859 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.215994 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.216193 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.216320 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.216509 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.216634 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.216827 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.216962 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.217151 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.217348 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.217474 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.217671 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.217805 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.218010 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.218137 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.218339 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.218574 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.218700 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.218894 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.219028 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.219228 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.219353 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.219553 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.219671 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.219879 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.220005 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.220207 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.220334 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.220521 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.220647 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.220833 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.220961 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.221136 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.221257 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.221437 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.221576 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.221750 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.221875 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.222052 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.222176 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.222356 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.222490 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.222674 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.222798 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.222983 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.223224 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.223358 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.223568 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.223695 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.223890 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.224045 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.224289 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.224464 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.224604 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.224815 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.224948 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.225137 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.225263 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.225469 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.225596 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.225797 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.225923 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.226103 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.226228 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.226414 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.226549 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.226721 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.226846 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.227025 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.227152 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.227328 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.227455 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.227637 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.227775 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.227944 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.228077 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.228253 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.228376 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.228565 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.228699 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.228864 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.228998 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.229177 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.229302 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.229482 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.229608 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.229784 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.229918 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.230087 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.230211 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.230398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.230526 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.230704 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.230843 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.231008 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.231135 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.231311 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.231434 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.231612 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.231751 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.231918 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.232049 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.232249 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.232375 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.232557 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.232684 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.232859 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.232991 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.233168 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.233301 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.233471 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.233595 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.233778 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.233911 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.234080 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.234211 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.234392 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.234518 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.234697 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.234823 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.235010 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.235143 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.235325 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.235451 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.235633 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.235767 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.235953 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.236090 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.236266 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.236400 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.236585 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.236710 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.236898 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.237096 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.237222 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.237343 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.237528 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.237752 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.237891 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.238088 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.238214 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.238407 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.238533 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.238741 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.239529 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.239669 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.239868 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.240001 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.240216 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.240343 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.240523 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.240649 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.240849 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.240975 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.241161 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.241295 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.241473 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.241592 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.241779 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.241903 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.242090 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.242215 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.242399 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.242532 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.242709 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.242833 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.243015 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.243148 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.243322 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.243447 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.243630 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.243755 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.243937 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.244070 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.244274 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.244401 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.244587 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.244712 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.244892 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.245030 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.245200 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.245324 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.245513 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.245640 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.245823 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.245956 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.246132 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.246266 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.246443 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.246569 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.246757 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.246885 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.247065 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.247192 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.247373 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.247500 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.247680 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.247806 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.247986 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.248141 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.248326 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.248452 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.248635 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.248761 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.248946 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.249072 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.249248 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.249373 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.249561 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.249685 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.249890 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.250016 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.250204 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.250338 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.250509 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.250637 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.250861 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.250985 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.251181 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.251316 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.251500 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.251625 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.251808 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.251933 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.252143 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.252273 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.252457 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.252582 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.252785 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.252911 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.253095 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.253221 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.253419 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.253548 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.253733 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.253861 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.254036 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.254160 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.254340 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.254993 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.255184 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.255321 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.255496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.255629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.255814 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.255941 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.256141 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.256283 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.256448 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.256574 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.256749 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.256883 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.257059 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.257194 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.257362 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.257489 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.257666 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.257790 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.257966 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.258092 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.258270 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.258403 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.258573 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.258706 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.258871 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.258997 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.259172 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.259296 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.259477 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.259609 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.259778 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.259911 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.260080 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.260226 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.260407 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.260542 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.260714 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.260839 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.261016 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.261143 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.261316 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.261449 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.261615 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.261739 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.261918 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.262044 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.262218 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.262350 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.262523 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.262648 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.262825 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.262951 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.263130 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.263266 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.263435 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.263568 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.263760 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.263892 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.264082 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.264259 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.264413 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.264539 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.264733 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.264862 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.265084 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.265216 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.265340 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.265461 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.265648 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.265774 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.265965 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.266091 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.266275 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.266401 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.266584 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.266718 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.266917 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.267043 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.267188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.267316 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.267495 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.267630 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.267805 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.267932 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.268126 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.268265 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.268447 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.268583 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.268755 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.268888 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.269066 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.269191 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.269380 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.269515 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.269703 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.269830 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.270009 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.270151 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.270340 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.270474 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.270668 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.270801 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.270976 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.271102 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.271284 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.271411 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.271593 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.271712 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.271898 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.272022 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.272229 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.272364 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.272543 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.272920 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.273110 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.273236 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.273419 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.273543 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.273730 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.273856 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.274041 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.274174 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.274354 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.274478 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.274678 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.274803 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.275000 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.275133 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.275313 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.275439 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.275638 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.275763 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.275960 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.276097 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.276300 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.276426 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.276612 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.276738 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.276917 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.277058 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.277181 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 16:50:12.277310 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.277576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.277890 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.278198 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:50:12.278443 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 16:50:12.429931 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO dbcounter [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Registered counter for database nova_api Jun 22 16:50:12.431068 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO dbcounter [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Registered counter for database nova_api Jun 22 16:50:12.451056 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_db.sqlalchemy.engines [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:50:12.452506 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG oslo_db.sqlalchemy.engines [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:50:12.458193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writer thread running {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:50:12.459527 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writer thread running {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:50:12.514986 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.context [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),889b0550-a155-4c00-a285-69151626d4f5(cell1) {{(pid=103731) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 16:50:12.516642 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.context [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),889b0550-a155-4c00-a285-69151626d4f5(cell1) {{(pid=103732) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 16:50:12.518887 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:50:12.521028 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:50:12.521135 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG oslo_concurrency.lockutils [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:50:12.521816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:50:12.522579 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG oslo_concurrency.lockutils [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:50:12.523615 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG oslo_concurrency.lockutils [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:50:12.524016 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:50:12.525597 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG oslo_concurrency.lockutils [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:50:12.525997 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO dbcounter [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Registered counter for database nova_cell0 Jun 22 16:50:12.527556 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO dbcounter [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Registered counter for database nova_cell0 Jun 22 16:50:12.530008 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO dbcounter [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Registered counter for database nova_cell1 Jun 22 16:50:12.531685 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO dbcounter [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Registered counter for database nova_cell1 Jun 22 16:50:12.537107 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_db.sqlalchemy.engines [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:50:12.539381 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_db.sqlalchemy.engines [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:50:12.541041 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG oslo_db.sqlalchemy.engines [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:50:12.542504 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG oslo_db.sqlalchemy.engines [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:50:12.544907 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writer thread running {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:50:12.547139 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writer thread running {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:50:12.548849 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writer thread running {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:50:12.551055 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writer thread running {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:50:12.692748 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO dbcounter [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Registered counter for database nova_cell0 Jun 22 16:50:12.695412 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO dbcounter [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Registered counter for database nova_cell0 Jun 22 16:50:12.701447 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_db.sqlalchemy.engines [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:50:12.704832 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG oslo_db.sqlalchemy.engines [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:50:12.705849 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writer thread running {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:50:12.709786 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writer thread running {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:50:13.120516 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: WARNING keystonemiddleware.auth_token [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 16:50:13.125165 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: WARNING keystonemiddleware.auth_token [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 16:50:13.127876 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: WARNING keystonemiddleware.auth_token [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 16:50:13.133684 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: WARNING keystonemiddleware.auth_token [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 16:50:13.467581 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: WARNING keystonemiddleware.auth_token [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 16:50:13.472752 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: WARNING keystonemiddleware.auth_token [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 16:50:13.473568 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: WARNING keystonemiddleware.auth_token [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 16:50:13.478685 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: WARNING keystonemiddleware.auth_token [None req-8a696c13-c271-42a2-b590-3235561f3517 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 16:50:13.478814 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f415e929c0 pid: 103731 (default app) Jun 22 16:50:13.480849 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:50:13.482057 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 Jun 22 16:50:13.482453 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Jun 22 16:50:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:50:13.483894 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f415e929c0 pid: 103732 (default app) Jun 22 16:51:30.937516 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:30.939377 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002814 Jun 22 16:51:30.940208 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:30.953033 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writing DB stats nova_api:SELECT=3 {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:30.953868 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writing DB stats nova_cell0:SELECT=3 {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:30.954786 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writing DB stats nova_cell1:SELECT=3 {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:30.956082 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:31.399471 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-083c4455-d672-477c-b2b2-6f59d5ffd574 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:31.427837 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-083c4455-d672-477c-b2b2-6f59d5ffd574 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.480042 Jun 22 16:51:31.429519 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 22 16:51:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:51:33.505317 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:33.506309 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-aa988c8c-30b7-423f-9123-ed22c100bf11 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jun 22 16:51:33.506705 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:33.565260 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-8fd09ce7-89b9-4837-a08e-4937e74618de admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:33.584506 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:51:33.584506 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: warnings.warn(msg) Jun 22 16:51:33.667972 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-8fd09ce7-89b9-4837-a08e-4937e74618de admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.155360 Jun 22 16:51:33.668481 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:51:33.886351 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-f2e1b5f1-f09c-4fef-aecd-5c4e8f9119d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:33.888756 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:51:33.888756 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: warnings.warn(msg) Jun 22 16:51:33.891417 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_api:SELECT=3 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:33.892375 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_cell1:SELECT=3 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:33.893154 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_cell0:SELECT=3 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:33.893838 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:34.008180 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-f2e1b5f1-f09c-4fef-aecd-5c4e8f9119d6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331126 Jun 22 16:51:34.009340 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 16:51:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:51:36.100031 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-8fd09ce7-89b9-4837-a08e-4937e74618de admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:36.101125 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-8fd09ce7-89b9-4837-a08e-4937e74618de admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jun 22 16:51:36.101514 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:36.208668 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-caecddaf-b113-4c74-99af-465ba9a3477b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 5, "id": "d1", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:36.226017 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:51:36.226017 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: warnings.warn(msg) Jun 22 16:51:36.321965 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-caecddaf-b113-4c74-99af-465ba9a3477b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.214260 Jun 22 16:51:36.322529 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:51:36.334704 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-d36544f9-79c0-4068-8e05-98ed147044cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:36.336250 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:51:36.336250 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: warnings.warn(msg) Jun 22 16:51:36.427725 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-d36544f9-79c0-4068-8e05-98ed147044cb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096740 Jun 22 16:51:36.428352 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 16:51:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:51:38.506334 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-caecddaf-b113-4c74-99af-465ba9a3477b admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:38.507898 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-caecddaf-b113-4c74-99af-465ba9a3477b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Jun 22 16:51:38.508319 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:38.566161 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-63afdcd3-9d15-4c11-9abc-60301152f1fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:38.668459 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-63afdcd3-9d15-4c11-9abc-60301152f1fc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154288 Jun 22 16:51:38.671103 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:51:38.680829 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-1071d4f5-66dd-45b6-ac24-030fdfed9c6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:38.757976 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-1071d4f5-66dd-45b6-ac24-030fdfed9c6e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080453 Jun 22 16:51:38.758918 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 16:51:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:51:40.852883 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-63afdcd3-9d15-4c11-9abc-60301152f1fc admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:40.853898 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-63afdcd3-9d15-4c11-9abc-60301152f1fc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 22 16:51:40.854433 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:40.912057 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-49cc42c5-6a70-4032-a8cb-d01081f87e2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:41.016793 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-49cc42c5-6a70-4032-a8cb-d01081f87e2e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156699 Jun 22 16:51:41.017343 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 16:51:41.030382 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-d6b314d2-e539-4b14-bd76-0469a6c20a90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:41.124182 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-d6b314d2-e539-4b14-bd76-0469a6c20a90 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097480 Jun 22 16:51:41.124767 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 16:51:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:51:43.197094 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-49cc42c5-6a70-4032-a8cb-d01081f87e2e admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:43.198243 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-49cc42c5-6a70-4032-a8cb-d01081f87e2e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jun 22 16:51:43.199871 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:43.275773 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-77b5ed47-fd0d-44e5-a05d-e88092a7baf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "ram": 4096, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4"}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:43.355197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-77b5ed47-fd0d-44e5-a05d-e88092a7baf1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149871 Jun 22 16:51:43.355749 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:51:43.367708 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-daf7f212-6f89-4a01-a3d4-a6417ac2d181 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:43.448774 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-daf7f212-6f89-4a01-a3d4-a6417ac2d181 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084285 Jun 22 16:51:43.460191 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 16:51:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:51:45.526437 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-77b5ed47-fd0d-44e5-a05d-e88092a7baf1 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:45.527455 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-77b5ed47-fd0d-44e5-a05d-e88092a7baf1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 22 16:51:45.528149 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:45.599141 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-72ba1732-6509-43a4-aa6b-09f5af927df1 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:45.622971 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-72ba1732-6509-43a4-aa6b-09f5af927df1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089034 Jun 22 16:51:45.624144 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 22 16:51:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:51:47.711004 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-77b5ed47-fd0d-44e5-a05d-e88092a7baf1 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:47.712025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-77b5ed47-fd0d-44e5-a05d-e88092a7baf1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 22 16:51:47.712473 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:47.777998 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-e679747b-4d9f-42d4-91e0-b221ae03275f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "disk": 1, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:47.858044 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-e679747b-4d9f-42d4-91e0-b221ae03275f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.138526 Jun 22 16:51:47.858628 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 16:51:47.873946 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-eacc6b0e-5835-4e79-a11e-c05e20bf3aed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:47.945542 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-eacc6b0e-5835-4e79-a11e-c05e20bf3aed admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075368 Jun 22 16:51:47.946546 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 16:51:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:51:50.109577 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-e679747b-4d9f-42d4-91e0-b221ae03275f admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:50.110597 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-e679747b-4d9f-42d4-91e0-b221ae03275f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 22 16:51:50.111173 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:50.171808 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-b79e0637-db37-47a7-b361-7bb7949eef25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "id": "2", "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "name": "m1.small"}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:50.249725 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-b79e0637-db37-47a7-b361-7bb7949eef25 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132531 Jun 22 16:51:50.250498 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:51:50.262555 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-ceb4e1e8-0ffe-4555-9068-33cca366a4ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:50.390934 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-ceb4e1e8-0ffe-4555-9068-33cca366a4ac admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131967 Jun 22 16:51:50.391563 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 16:51:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:51:52.452200 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-b79e0637-db37-47a7-b361-7bb7949eef25 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:52.453216 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-b79e0637-db37-47a7-b361-7bb7949eef25 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 22 16:51:52.453620 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:52.511805 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-367a1a07-f151-4a14-8229-40b90e488ab0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:52.600970 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-367a1a07-f151-4a14-8229-40b90e488ab0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.141339 Jun 22 16:51:52.604184 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 16:51:52.613556 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-562208b7-b877-409b-981b-44e3fba79eaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:52.699744 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-562208b7-b877-409b-981b-44e3fba79eaf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089719 Jun 22 16:51:52.700301 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 16:51:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:51:54.779260 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-367a1a07-f151-4a14-8229-40b90e488ab0 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:54.780323 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-367a1a07-f151-4a14-8229-40b90e488ab0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 22 16:51:54.780722 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:54.838316 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-cd22994d-4d0d-44ae-aa91-3612eecf5126 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:54.937557 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-cd22994d-4d0d-44ae-aa91-3612eecf5126 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151165 Jun 22 16:51:54.938116 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:51:54.950317 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-9aaca462-149c-4cae-96cd-1a19f385d0ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:55.033007 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-9aaca462-149c-4cae-96cd-1a19f385d0ca admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086660 Jun 22 16:51:55.033656 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 16:51:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:51:57.151943 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-cd22994d-4d0d-44ae-aa91-3612eecf5126 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:51:57.152994 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-cd22994d-4d0d-44ae-aa91-3612eecf5126 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 22 16:51:57.153655 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:51:57.220892 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-a925ab61-39dd-40a8-989c-3de5d0a387c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "id": "5"}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:57.292694 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-a925ab61-39dd-40a8-989c-3de5d0a387c0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.133026 Jun 22 16:51:57.293544 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 16:51:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:51:57.306389 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-0ec6446a-2e87-403b-a9a8-777cb0b8b03a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:51:57.376058 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-0ec6446a-2e87-403b-a9a8-777cb0b8b03a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073489 Jun 22 16:51:57.376765 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 16:51:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:52:22.484367 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-a925ab61-39dd-40a8-989c-3de5d0a387c0 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:22.485376 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-a925ab61-39dd-40a8-989c-3de5d0a387c0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 22 16:52:22.485769 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:22.496575 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:52:22.543595 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-cd625be3-897d-496a-90ee-225290265f9e admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:22.561212 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-cd625be3-897d-496a-90ee-225290265f9e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069223 Jun 22 16:52:22.561745 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 22 16:52:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:52:23.489377 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-a925ab61-39dd-40a8-989c-3de5d0a387c0 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:23.490399 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-a925ab61-39dd-40a8-989c-3de5d0a387c0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jun 22 16:52:23.490787 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:23.680228 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-9e587745-1ba2-446b-a30a-58378209c81e admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:23.685802 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.wsgi [None req-9e587745-1ba2-446b-a30a-58378209c81e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-9e587745-1ba2-446b-a30a-58378209c81e admin admin] Request method failure captured: Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Accept: application/json Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Accept-Encoding: gzip, deflate Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Connection: keep-alive Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Content-Length: 0 Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Host: 10.222.0.18 Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Openstack-Api-Version: compute 2.90 Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Openstack-System-Scope: None Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: User-Agent: python-novaclient Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Auth-Token: gAAAAABis0jH1f7uX-3JIoPUJRVoUX-mzQxReJnUfQ-cb_HlAnfAcqki_hNmhk-hk3F673d2sRAeMYX0d4-Ydkcg9wEf3A_pbNuTZdoeUkyLq4RM4A9bTTZl_Z1L2NVdQNfyXjM2kfysNJPfpVkHP2Kk2dhUt_rxhcu4clFRsUggAcp4WJPpeEo Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Domain-Id: None Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Domain-Name: None Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Identity-Status: Confirmed Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Is-Admin-Project: True Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Domain-Id: default Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Domain-Name: Default Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Name: admin Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Role: admin,reader,member Jun 22 16:52:23.689032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Roles: admin,reader,member Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant: admin Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant-Name: admin Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User: admin Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Domain-Id: default Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Domain-Name: Default Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Id: 2ba6ed129dc941f49c2206f6d2b62dfd Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Name: admin Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: method: > Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: exception: Flavor 42 could not be found. Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: action_args: {'id': '42'} Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:52:23.690789 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:23.692629 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.694025 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-9e587745-1ba2-446b-a30a-58378209c81e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:52:23.695322 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-9e587745-1ba2-446b-a30a-58378209c81e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062135 Jun 22 16:52:23.695322 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 22 16:52:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:23.700597 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-ff2fec25-bdbe-4245-8170-50ed6daa296f admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:23.703400 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:52:23.722062 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-ff2fec25-bdbe-4245-8170-50ed6daa296f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025007 Jun 22 16:52:23.722595 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 16:52:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:52:23.731931 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-75d69623-5645-4fb7-825e-7a86e746bf93 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:23.754353 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-75d69623-5645-4fb7-825e-7a86e746bf93 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025376 Jun 22 16:52:23.754874 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 16:52:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 16:52:23.764354 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-acbc6958-c49c-43be-96ee-f76d5f44caa4 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:23.770901 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.wsgi [None req-acbc6958-c49c-43be-96ee-f76d5f44caa4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-acbc6958-c49c-43be-96ee-f76d5f44caa4 admin admin] Request method failure captured: Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Accept: application/json Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Accept-Encoding: gzip, deflate Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Connection: keep-alive Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Content-Length: 0 Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Host: 10.222.0.18 Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Openstack-Api-Version: compute 2.90 Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Openstack-System-Scope: None Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: User-Agent: python-novaclient Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Auth-Token: gAAAAABis0jH1f7uX-3JIoPUJRVoUX-mzQxReJnUfQ-cb_HlAnfAcqki_hNmhk-hk3F673d2sRAeMYX0d4-Ydkcg9wEf3A_pbNuTZdoeUkyLq4RM4A9bTTZl_Z1L2NVdQNfyXjM2kfysNJPfpVkHP2Kk2dhUt_rxhcu4clFRsUggAcp4WJPpeEo Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Domain-Id: None Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Domain-Name: None Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Identity-Status: Confirmed Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Is-Admin-Project: True Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Domain-Id: default Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Domain-Name: Default Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Name: admin Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Role: admin,reader,member Jun 22 16:52:23.774398 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Roles: admin,reader,member Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant: admin Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant-Name: admin Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User: admin Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Domain-Id: default Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Domain-Name: Default Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Id: 2ba6ed129dc941f49c2206f6d2b62dfd Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Name: admin Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: method: > Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: exception: Flavor 42 could not be found. Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: action_args: {'id': '42'} Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:52:23.784188 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:23.785193 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:23.786499 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-acbc6958-c49c-43be-96ee-f76d5f44caa4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:52:23.787711 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-acbc6958-c49c-43be-96ee-f76d5f44caa4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015348 Jun 22 16:52:23.787711 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 22 16:52:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 16:52:24.591419 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-75d69623-5645-4fb7-825e-7a86e746bf93 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:24.592470 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-75d69623-5645-4fb7-825e-7a86e746bf93 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 22 16:52:24.592854 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:24.795038 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-10faef09-48db-4417-97d3-34a0cd072d39 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:24.801337 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.wsgi [None req-10faef09-48db-4417-97d3-34a0cd072d39 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-10faef09-48db-4417-97d3-34a0cd072d39 admin admin] Request method failure captured: Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Accept: application/json Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Accept-Encoding: gzip, deflate Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Connection: keep-alive Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Content-Length: 0 Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Host: 10.222.0.18 Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Openstack-Api-Version: compute 2.90 Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Openstack-System-Scope: None Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: User-Agent: python-novaclient Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Auth-Token: gAAAAABis0jIPZe-DmXzUAw95MdPOJpYWrWZ3r0Q39svk32qSGsOrPNX31m2pOv2FAjWmfdUUV8zFFdyaso4RF_18c5XNy4PV633GZry8le4efkScz1fTRb14l9yyPQxnn7CJmqDwRNjGxjVzfEEXLFyD9UFaO0Z3HKVINtIgSWo0LOxMpoAD70 Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Domain-Id: None Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Domain-Name: None Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Identity-Status: Confirmed Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Is-Admin-Project: True Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Domain-Id: default Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Domain-Name: Default Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Name: admin Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Role: admin,reader,member Jun 22 16:52:24.803912 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Roles: admin,reader,member Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant: admin Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant-Name: admin Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User: admin Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Domain-Id: default Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Domain-Name: Default Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Id: 2ba6ed129dc941f49c2206f6d2b62dfd Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Name: admin Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: method: > Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: exception: Flavor 84 could not be found. Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: action_args: {'id': '84'} Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:52:24.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:24.806491 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.807816 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-10faef09-48db-4417-97d3-34a0cd072d39 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:52:24.809310 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-10faef09-48db-4417-97d3-34a0cd072d39 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061533 Jun 22 16:52:24.809310 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 22 16:52:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:24.814865 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-6dac60d1-e949-4ff4-aa1a-62e47cbfef84 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:24.829196 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-6dac60d1-e949-4ff4-aa1a-62e47cbfef84 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017839 Jun 22 16:52:24.829715 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 16:52:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:52:24.839198 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-4da82cef-ea39-4b69-ae9a-ae1b11590c9c admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:24.854238 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-4da82cef-ea39-4b69-ae9a-ae1b11590c9c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018605 Jun 22 16:52:24.854784 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 16:52:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 16:52:24.864569 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-5ac2ac2d-2f54-4242-8ebd-2d05b24116af admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:24.870008 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.wsgi [None req-5ac2ac2d-2f54-4242-8ebd-2d05b24116af admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-5ac2ac2d-2f54-4242-8ebd-2d05b24116af admin admin] Request method failure captured: Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Accept: application/json Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Accept-Encoding: gzip, deflate Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Connection: keep-alive Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Content-Length: 0 Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Host: 10.222.0.18 Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Openstack-Api-Version: compute 2.90 Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Openstack-System-Scope: None Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: User-Agent: python-novaclient Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Auth-Token: gAAAAABis0jIPZe-DmXzUAw95MdPOJpYWrWZ3r0Q39svk32qSGsOrPNX31m2pOv2FAjWmfdUUV8zFFdyaso4RF_18c5XNy4PV633GZry8le4efkScz1fTRb14l9yyPQxnn7CJmqDwRNjGxjVzfEEXLFyD9UFaO0Z3HKVINtIgSWo0LOxMpoAD70 Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Domain-Id: None Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Domain-Name: None Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Identity-Status: Confirmed Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Is-Admin-Project: True Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Domain-Id: default Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Domain-Name: Default Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Name: admin Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Role: admin,reader,member Jun 22 16:52:24.871486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Roles: admin,reader,member Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant: admin Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant-Name: admin Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User: admin Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Domain-Id: default Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Domain-Name: Default Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Id: 2ba6ed129dc941f49c2206f6d2b62dfd Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Name: admin Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: method: > Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: exception: Flavor 84 could not be found. Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: action_args: {'id': '84'} Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:52:24.873071 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:24.873948 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:24.875197 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-5ac2ac2d-2f54-4242-8ebd-2d05b24116af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:52:24.876486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-5ac2ac2d-2f54-4242-8ebd-2d05b24116af admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012397 Jun 22 16:52:24.876486 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 22 16:52:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:25.686611 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-4da82cef-ea39-4b69-ae9a-ae1b11590c9c admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:25.687604 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-4da82cef-ea39-4b69-ae9a-ae1b11590c9c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jun 22 16:52:25.687990 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:25.873844 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-d3b8ef8f-2c8f-4529-953f-9035881ffbf5 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:25.880068 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.wsgi [None req-d3b8ef8f-2c8f-4529-953f-9035881ffbf5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-d3b8ef8f-2c8f-4529-953f-9035881ffbf5 admin admin] Request method failure captured: Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Accept: application/json Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Accept-Encoding: gzip, deflate Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Connection: keep-alive Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Content-Length: 0 Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Host: 10.222.0.18 Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Openstack-Api-Version: compute 2.90 Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Openstack-System-Scope: None Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: User-Agent: python-novaclient Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Auth-Token: gAAAAABis0jJQoe8aRiuhIyHayypoV7u7rJTc1XrHQOYQH9lg4Sbg0c3ZUdB_7Vao69Fc57bKjpAxhA61SsIC-l7R08vJNwr33r4a4g8XRh7yYyeRFQLKHtovZCfxHKl_y-Im2luH60BKnNeStxj_ACDkCW5vVpFGCn7DkrNP1gqEwGfG76WEzs Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Domain-Id: None Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Domain-Name: None Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Identity-Status: Confirmed Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Is-Admin-Project: True Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Domain-Id: default Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Domain-Name: Default Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Project-Name: admin Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Role: admin,reader,member Jun 22 16:52:25.881576 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Roles: admin,reader,member Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant: admin Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-Tenant-Name: admin Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User: admin Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Domain-Id: default Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Domain-Name: Default Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Id: 2ba6ed129dc941f49c2206f6d2b62dfd Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: X-User-Name: admin Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: method: > Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: exception: Flavor 451 could not be found. Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: action_args: {'id': '451'} Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:52:25.883159 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:25.884155 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.885466 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-d3b8ef8f-2c8f-4529-953f-9035881ffbf5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:52:25.886720 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-d3b8ef8f-2c8f-4529-953f-9035881ffbf5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059847 Jun 22 16:52:25.886720 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 16:52:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:25.892562 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-b3486602-d3c7-4877-95f6-01ee908a46d5 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:25.906360 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-b3486602-d3c7-4877-95f6-01ee908a46d5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017315 Jun 22 16:52:25.906869 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 16:52:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:52:25.916283 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:25.930068 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017143 Jun 22 16:52:25.930578 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 16:52:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 16:52:25.939333 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-9896cd6c-783c-4026-9754-f66c518c7be3 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:25.944582 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.wsgi [None req-9896cd6c-783c-4026-9754-f66c518c7be3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-9896cd6c-783c-4026-9754-f66c518c7be3 admin admin] Request method failure captured: Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Accept: application/json Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Accept-Encoding: gzip, deflate Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Connection: keep-alive Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Content-Length: 0 Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Host: 10.222.0.18 Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Openstack-Api-Version: compute 2.90 Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Openstack-System-Scope: None Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: User-Agent: python-novaclient Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Auth-Token: gAAAAABis0jJQoe8aRiuhIyHayypoV7u7rJTc1XrHQOYQH9lg4Sbg0c3ZUdB_7Vao69Fc57bKjpAxhA61SsIC-l7R08vJNwr33r4a4g8XRh7yYyeRFQLKHtovZCfxHKl_y-Im2luH60BKnNeStxj_ACDkCW5vVpFGCn7DkrNP1gqEwGfG76WEzs Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Domain-Id: None Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Domain-Name: None Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Identity-Status: Confirmed Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Is-Admin-Project: True Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Domain-Id: default Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Domain-Name: Default Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Project-Name: admin Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Role: admin,reader,member Jun 22 16:52:25.946061 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Roles: admin,reader,member Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/591e7cfe38c74f35852c3e0ac79addb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant: admin Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant-Id: 591e7cfe38c74f35852c3e0ac79addb7 Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-Tenant-Name: admin Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User: admin Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Domain-Id: default Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Domain-Name: Default Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Id: 2ba6ed129dc941f49c2206f6d2b62dfd Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: X-User-Name: admin Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: method: > Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: exception: Flavor 451 could not be found. Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: action_args: {'id': '451'} Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:52:25.947629 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:25.948658 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: ERROR nova.api.openstack.wsgi Jun 22 16:52:25.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-9896cd6c-783c-4026-9754-f66c518c7be3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:52:25.951229 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-9896cd6c-783c-4026-9754-f66c518c7be3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011508 Jun 22 16:52:25.951229 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 16:52:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 16:52:26.771415 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:26.772465 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 22 16:52:26.772892 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:26.962076 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-f71c69a3-240a-41da-9445-58b21e349d69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:52:27.057689 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-f71c69a3-240a-41da-9445-58b21e349d69 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.147319 Jun 22 16:52:27.059796 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 22 16:52:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 16:52:27.873838 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:27.874842 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 22 16:52:27.875234 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:28.070973 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-d58c4670-2b3d-4fc3-8b10-dc98c1bfbede admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:52:28.148894 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-d58c4670-2b3d-4fc3-8b10-dc98c1bfbede admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.135896 Jun 22 16:52:28.149706 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 22 16:52:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:52:28.963335 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:28.964400 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 22 16:52:28.964792 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:29.153887 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-e0efc2c6-40c8-42e3-b152-3a113dd6e5a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:52:29.248344 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-e0efc2c6-40c8-42e3-b152-3a113dd6e5a7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.144459 Jun 22 16:52:29.248815 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 22 16:52:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:52:30.067801 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:30.068846 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 22 16:52:30.069243 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:30.266267 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-056f975e-841a-473c-ac3c-66c8900548fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:52:30.348356 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-056f975e-841a-473c-ac3c-66c8900548fa admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.133294 Jun 22 16:52:30.348904 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 22 16:52:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:52:31.158272 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:31.159294 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 22 16:52:31.159684 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:52:31.348069 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-07be8482-13fb-4315-98dc-5f0bd1ff92fb admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:52:31.366924 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-07be8482-13fb-4315-98dc-5f0bd1ff92fb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070031 Jun 22 16:52:31.367450 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Jun 22 16:52:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:53:18.261032 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:53:18.262029 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-fefd52e2-1b0c-4368-b791-d79754834404 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 22 16:53:18.262419 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 16:53:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:53:18.272625 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:53:18.320644 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-90ab65a0-db67-4d5b-9e8b-2237ea926a03 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:53:18.340059 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-90ab65a0-db67-4d5b-9e8b-2237ea926a03 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071994 Jun 22 16:53:18.340616 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 22 16:53:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:53:18.363314 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-99bf8565-7d40-4e46-b0ea-96449eb0df5f admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:53:18.366733 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG dbcounter [-] [103732] Writing DB stats nova_api:SELECT=14 {{(pid=103732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:53:18.371595 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-99bf8565-7d40-4e46-b0ea-96449eb0df5f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011842 Jun 22 16:53:18.372123 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jun 22 16:53:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:53:18.383176 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-88547a78-ba8a-4ffe-a652-e81586d5d241 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:53:18.390803 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-88547a78-ba8a-4ffe-a652-e81586d5d241 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011192 Jun 22 16:53:18.391302 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jun 22 16:53:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:53:18.405473 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:53:18.417915 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018324 Jun 22 16:53:18.418443 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jun 22 16:53:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:53:18.430797 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-1803c419-9392-4f57-9a71-931ab713b20e admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:53:18.438514 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-1803c419-9392-4f57-9a71-931ab713b20e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011284 Jun 22 16:53:18.439024 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jun 22 16:53:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:56:47.770474 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:56:47.771494 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 22 16:56:47.771920 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:56:47.914123 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_api:SELECT=6 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:56:48.035185 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-cf886a4a-359f-4d24-8e17-a0d871bc2a77 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:56:48.036357 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:56:48.036357 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: warnings.warn(msg) Jun 22 16:56:48.037534 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-cf886a4a-359f-4d24-8e17-a0d871bc2a77 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:56:48.037979 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-cf886a4a-359f-4d24-8e17-a0d871bc2a77 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:56:48.038778 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-cf886a4a-359f-4d24-8e17-a0d871bc2a77 admin admin] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:56:48.039201 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-cf886a4a-359f-4d24-8e17-a0d871bc2a77 admin admin] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:56:48.073385 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-cf886a4a-359f-4d24-8e17-a0d871bc2a77 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.160731 Jun 22 16:56:48.073942 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 16:56:47 2022] GET /compute/v2.1/os-services => generated 794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 16:56:48.901221 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:56:48.902228 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Jun 22 16:56:48.902619 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:56:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:56:49.090296 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-6aa67429-77de-432e-9540-d1c518efc701 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:56:49.091453 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:56:49.091453 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: warnings.warn(msg) Jun 22 16:56:49.092666 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-6aa67429-77de-432e-9540-d1c518efc701 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:56:49.093107 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-6aa67429-77de-432e-9540-d1c518efc701 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:56:49.093906 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-6aa67429-77de-432e-9540-d1c518efc701 admin admin] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:56:49.094337 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-6aa67429-77de-432e-9540-d1c518efc701 admin admin] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:56:49.113530 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-6aa67429-77de-432e-9540-d1c518efc701 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074113 Jun 22 16:56:49.114012 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 16:56:49 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 16:57:00.372525 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:57:00.373527 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 22 16:57:00.373918 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:57:00.515321 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_cell0:SELECT=4 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:57:00.516055 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_cell1:SELECT=4 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:57:00.516690 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG dbcounter [-] [103731] Writing DB stats nova_api:SELECT=8 {{(pid=103731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:57:00.565504 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-80ad0adb-e31c-48e5-815e-ee6765b6bb73 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:57:00.573165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:57:00.573165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: warnings.warn(msg) Jun 22 16:57:00.573165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-80ad0adb-e31c-48e5-815e-ee6765b6bb73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:57:00.573165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-80ad0adb-e31c-48e5-815e-ee6765b6bb73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:57:00.573165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-80ad0adb-e31c-48e5-815e-ee6765b6bb73 admin admin] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:57:00.573165 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-80ad0adb-e31c-48e5-815e-ee6765b6bb73 admin admin] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:57:00.594396 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-80ad0adb-e31c-48e5-815e-ee6765b6bb73 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083437 Jun 22 16:57:00.601687 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 16:57:00 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:57:01.441066 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: DEBUG nova.api.openstack.wsgi [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] Calling method '>' {{(pid=103732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:57:01.442210 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: INFO nova.api.openstack.requestlog [None req-013f378c-dc3a-4cf3-8d26-3977b03facd5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 22 16:57:01.442604 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: [pid: 103732|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 16:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:57:01.630410 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG nova.api.openstack.wsgi [None req-e9f12a88-5025-4fb9-bc61-faf105fba685 admin admin] Calling method '>' {{(pid=103731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:57:01.631558 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:57:01.631558 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: warnings.warn(msg) Jun 22 16:57:01.633199 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-e9f12a88-5025-4fb9-bc61-faf105fba685 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:57:01.634367 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-e9f12a88-5025-4fb9-bc61-faf105fba685 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:57:01.635330 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-e9f12a88-5025-4fb9-bc61-faf105fba685 admin admin] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:57:01.635759 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: DEBUG oslo_concurrency.lockutils [None req-e9f12a88-5025-4fb9-bc61-faf105fba685 admin admin] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:57:01.657128 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: INFO nova.api.openstack.requestlog [None req-e9f12a88-5025-4fb9-bc61-faf105fba685 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.076798 Jun 22 16:57:01.657659 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: [pid: 103731|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 16:57:01 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 16:57:59.590156 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: Wed Jun 22 16:57:59 2022 - graceful shutdown triggered... Jun 22 16:57:59.590392 dv-cinder-810457-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 16:57:59.591081 dv-cinder-810457-10-iscsi devstack@n-api.service[103732]: Gracefully killing worker 2 (pid: 103732)... Jun 22 16:57:59.591543 dv-cinder-810457-10-iscsi devstack@n-api.service[103731]: Gracefully killing worker 1 (pid: 103731)... Jun 22 16:58:00.591291 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: worker 1 buried after 1 seconds Jun 22 16:58:00.591772 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: worker 2 buried after 1 seconds Jun 22 16:58:00.591772 dv-cinder-810457-10-iscsi devstack@n-api.service[103730]: goodbye to uWSGI. Jun 22 16:58:00.592841 dv-cinder-810457-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 16:58:00.593401 dv-cinder-810457-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 16:58:00.596192 dv-cinder-810457-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 16:58:00.606132 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 16:58:00 2022] *** Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: nodename: dv-cinder-810457-10-iscsi Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: machine: x86_64 Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: clock source: unix Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: pcre jit disabled Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: detected number of CPU cores: 4 Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: current working directory: / Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: detected binary path: /usr/bin/uwsgi-core Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: your processes number limit is 47680 Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: your memory page size is 4096 bytes Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: detected max file descriptor number: 2048 Jun 22 16:58:00.608210 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: lock engine: pthread robust mutexes Jun 22 16:58:00.609259 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: thunder lock: enabled Jun 22 16:58:00.609259 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 16:58:00.609259 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 16:58:00.652965 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: Python main interpreter initialized at 0x55d6c5bf29c0 Jun 22 16:58:00.652965 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: python threads support enabled Jun 22 16:58:00.652965 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: your server socket listen backlog is limited to 100 connections Jun 22 16:58:00.652965 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: your mercy for graceful operations on workers is 90 seconds Jun 22 16:58:00.653404 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 16:58:00.653404 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: *** Operational MODE: preforking *** Jun 22 16:58:00.653701 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: *** uWSGI is running in multiple interpreter mode *** Jun 22 16:58:00.653701 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: spawned uWSGI master process (pid: 118459) Jun 22 16:58:00.653920 dv-cinder-810457-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 16:58:00.655339 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: spawned uWSGI worker 1 (pid: 118471, cores: 1) Jun 22 16:58:00.655339 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: spawned uWSGI worker 2 (pid: 118472, cores: 1) Jun 22 16:58:00.655339 dv-cinder-810457-10-iscsi devstack@n-api.service[118459]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 16:58:01.312542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 16:58:01.313064 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 16:58:02.512529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:58:02.512529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: from cryptography.utils import int_from_bytes Jun 22 16:58:02.513169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:58:02.513169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: from cryptography.utils import int_from_bytes Jun 22 16:58:02.535243 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:58:02.535243 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: from cryptography.utils import int_from_bytes Jun 22 16:58:02.535773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:58:02.535773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: from cryptography.utils import int_from_bytes Jun 22 16:58:04.904989 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 16:58:04.905615 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 16:58:04.905913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 16:58:04.906288 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 16:58:04.906545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 16:58:04.906939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.907268 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.907595 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.907917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.908280 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.908595 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.908919 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.909252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.909574 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.909839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.910156 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.910483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810457-10-iscsi {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.910925 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.911104 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.911521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.911741 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.912052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.912409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.912720 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.913227 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.915163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.915163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.915163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.915578 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.915783 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.916096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.916449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.916772 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.917093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.917403 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.917821 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810457-10-iscsi {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.918139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.918543 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.918798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.919277 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.919515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.919825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.920163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.921169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.921169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.921169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.921437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.921723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.922036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.922354 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.922646 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.922962 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.923283 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.923586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.923890 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.924161 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.924469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.924786 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.925104 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.925427 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.925677 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.925926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.926243 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.926560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.926867 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.927162 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.927472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.927779 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.928091 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.928430 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.928773 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.929041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.929356 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.929668 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.929992 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.930878 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.931202 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.931604 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.931852 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.932178 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.932528 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.932868 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.933152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.933478 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.933793 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.934098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.934401 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.934708 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.935028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.935364 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.935667 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.935916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.936254 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.936561 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.936878 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.937187 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.937489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.937796 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.938095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.938399 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.938730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.939003 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.939308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.939614 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.939916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.940248 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.940556 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.940858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.941178 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.941500 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.941804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.942112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.942418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.942770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.943225 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.943542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.943852 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.943963 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 16:58:04.944416 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 16:58:04.944500 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.944500 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.944773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 16:58:04.944879 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.945080 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 16:58:04.945191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.945341 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 16:58:04.945443 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.945691 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.945792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.946060 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.946170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.946361 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.946471 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.946668 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.946771 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.946984 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.947087 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.947289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.947416 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.947598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.947706 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.947892 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.947997 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.948202 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.948373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.948482 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.948802 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.949084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.949191 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810457-10-iscsi {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.949436 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.949747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.950017 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.950130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.950368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.950674 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.951331 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.951331 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.951593 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.951796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.952136 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.952426 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.952547 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.952740 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.953082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.953301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.953423 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.953700 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.954037 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.954536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.954870 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.955227 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.955609 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.955886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.956228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.961227 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.961345 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.961974 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.962124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.962223 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.962223 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.962375 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.962464 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.962548 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810457-10-iscsi {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.962631 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.962704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.962775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.962856 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.962943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.963024 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.963096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.963178 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.963259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.963339 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.963421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.963505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.963584 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.963657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.963756 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.964263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.964440 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.964634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.964797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.964946 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.965102 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.965102 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.965402 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.965402 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.965734 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.965886 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.966064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.966226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.966374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.966521 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.966675 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.966833 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.966980 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.967149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.967305 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.967460 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.967608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.968288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.968473 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.968690 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.968852 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.969001 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.969160 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.969327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.969487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.969661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.969824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.969990 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.970149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.970304 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.970467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.970643 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.970802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.970959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.971986 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.972216 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.972375 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.972533 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.972735 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.972890 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.972890 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.973180 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.973329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.973812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.973812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.974119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.974119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.974411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.974571 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.974726 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.974881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.975038 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.975193 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.975354 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.975517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.975676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.975832 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.975980 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.976164 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.976382 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.976546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.976702 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.976702 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.981096 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.981096 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.982528 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.982689 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.982853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.983006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.983165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.983165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.983480 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.983630 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.983811 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.984071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.984330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.984592 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.984753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.984952 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.985105 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.985261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.985417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.985576 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.985733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.985882 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.986038 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.986205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.986449 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.986601 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.986757 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.986905 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.987052 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.987205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.987368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.987517 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.988302 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.988467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.988618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.988765 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.988939 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.989095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.989252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.989446 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.989600 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.989756 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.989913 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.990070 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.990226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.990381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.990570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.990735 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.990907 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.991065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.991220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.991715 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.992141 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.992310 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.992460 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.992642 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.992807 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.993009 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.993170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.993327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.993491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.993686 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.993841 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.993996 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.994254 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.994409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.994685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.994845 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.994993 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.995142 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.995289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.995444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.995561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.995654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.995654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.995880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.995981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.996076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.996191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.996191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.996191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.996191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.996191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.996191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.996191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.996936 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.997033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.997129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.997217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.997314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.997402 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.997494 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.997595 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.997691 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.997825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.997920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.998007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.998102 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.998202 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.998292 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.998378 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.998474 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.998570 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.998664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.999222 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.999336 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.999427 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.999523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.999618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.999716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:04.999804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:04.999942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.000044 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.000170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.000273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.000373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.000469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.000558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.000645 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.000731 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.000823 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.000925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.001013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.001164 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.001253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.001253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.001253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.001253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.001253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.001253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.001253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.001253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003233 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.003332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.003522 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003522 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003522 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003767 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.003856 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003856 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003856 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003856 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.003856 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.004846 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.004922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.004922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.004922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.004922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005213 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.005300 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:58:05.005455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.005733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006163 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006485 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006574 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.006835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007118 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007377 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.007969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.010622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.010622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.010622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.010622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.010622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.010622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.010622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.011150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.011247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.011247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.011425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.011521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.011521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.011521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.012405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.012511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.012602 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.012704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.012792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.012792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.013023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.013285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.013387 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.013646 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.013964 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.014193 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.014287 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.014576 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.014890 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.015018 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.015201 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.015523 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.015629 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.015830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.016160 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.016285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.016496 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.016775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.017087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.017179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.017406 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.017726 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.017985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.018260 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.018355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.018621 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.018862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.018957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.020261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.020261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.020451 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.020526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.020526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.020681 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.020907 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.021224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.021531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.021835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.022482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.022482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.022741 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.023043 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.023356 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.026341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.026341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.027548 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.027736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.027907 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.028075 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.028317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.028478 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.028633 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.028798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.028953 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.029125 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.029125 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.029440 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.029605 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.029770 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.029933 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.030094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.030250 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.030411 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.030581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.030736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.030897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.031052 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.031216 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.031378 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.032060 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.032819 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.032995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.032995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.033303 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.033467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.033638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.033793 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.033955 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.034108 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.034260 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.034440 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.034603 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.034766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.034919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.035071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.035233 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.035397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.035397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.035397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.035397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.035397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.036170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.036345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.036513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.036673 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.036673 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.036966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.037129 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.037298 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.037459 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.037716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.037886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.038068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.038319 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.038497 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.038666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.038976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.039136 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.039290 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.039459 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.040206 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.040368 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.040530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.040728 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.040896 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.041065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.041220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.041373 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.041538 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.041700 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.041863 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.042028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.042190 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.042816 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.043109 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.043288 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.043452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.043659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.043818 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.043973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.044155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.044338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.044504 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.044704 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.044862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.045014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.045176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.045358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.045358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.046260 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047249 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047431 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047735 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047965 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.047965 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.048154 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.048244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.052895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.052993 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053091 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053165 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053246 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053557 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053636 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053717 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.053951 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054194 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054360 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054360 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054501 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054572 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054650 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054729 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054809 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054977 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.054977 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055154 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055379 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055469 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055552 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055626 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055706 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055868 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.055941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056019 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056251 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056326 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056407 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056585 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056824 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056910 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.056989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057063 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057225 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057306 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057523 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057689 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057771 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.057933 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058020 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058573 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058805 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058886 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.058959 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059031 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059560 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059641 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059799 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.059951 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060232 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060232 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060232 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060563 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060649 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060735 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060825 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060908 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.060989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061069 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061142 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061501 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061572 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061650 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061735 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061816 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.061976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.062056 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.062128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.062265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.062342 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.062413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.062492 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.062597 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.062988 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063385 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063547 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063627 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063720 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.063960 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064033 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064412 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064496 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064569 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064651 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064731 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064864 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.064943 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065015 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065179 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065179 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065572 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065650 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065723 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065803 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065892 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.065968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.066210 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.066342 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.066532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.066630 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.066832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.066923 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.067137 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.067228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.067442 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.067601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.067764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.067856 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.068068 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.068174 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.068403 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.068505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.068715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.068798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.069030 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.069112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.069352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.069445 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.069747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.070053 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.070247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.070564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.070977 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.071079 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.071369 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.071613 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.071715 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.071971 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.072141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.072321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.072455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.072639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.072769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.072953 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.073150 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.073281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.073421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.073615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.073737 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.073936 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.074064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.074264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.074358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.074594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.074704 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.074906 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.075004 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.075218 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.075319 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.075549 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.075658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.075866 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.075967 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.076198 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.076311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.076511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.076618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.076820 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.076910 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.077174 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.077257 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.077490 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.077581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.077796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.077897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.078104 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.078203 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.078409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.078546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.078716 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.078809 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.079033 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.079132 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.079335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.079435 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.079647 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.079740 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.079957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.080057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.080293 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.080402 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.080599 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.080723 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.080903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.081017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.081226 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.081386 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.081531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.081675 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.081840 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.082012 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.082172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.082317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.082458 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.082606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.082764 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.082883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.083146 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.086921 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087049 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087147 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087236 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087330 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087467 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087566 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087566 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087725 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.087923 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.088009 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.088084 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091186 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091348 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091600 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091672 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091751 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091910 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.091992 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092066 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092249 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092346 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092492 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092563 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092633 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092820 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.092918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093013 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093124 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093223 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093324 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093412 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093497 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093583 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093668 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093761 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.093953 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094147 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094232 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094342 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094441 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094616 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094697 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094776 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.094859 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.095426 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.095515 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.095590 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.095670 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.095757 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.095838 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.095933 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.095933 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096268 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096351 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096351 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.096957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.097045 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.097126 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.097126 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.097266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.097570 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.097669 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.097824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.097950 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.098098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.098262 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.098514 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.098620 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.098758 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.098875 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.099080 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.099164 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.099402 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.099485 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.099726 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.099817 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.100046 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.100166 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.100395 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.100495 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.100715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.100798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.101024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.101106 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.101328 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.101420 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.101792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.101897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.101981 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.103355 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.103531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.103718 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.103718 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.104024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.104209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.104367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.104521 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.104521 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.104906 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.105064 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.105234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.105394 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.105394 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.105713 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.105881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.106038 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.106200 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.106381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.106567 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.106723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.106891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107058 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107214 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107377 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107585 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107766 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107766 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107907 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.107991 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.108224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.108344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.108564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.108694 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.108912 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.109047 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.109239 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.109550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.109662 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.109884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.110048 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.110171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.110487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.110606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.110831 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.111065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.111156 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.111237 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.111394 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.111503 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.111703 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.111815 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.112009 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.112148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.112356 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.112461 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.112664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.112759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.112974 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.113069 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.113283 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.113378 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.113610 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.113699 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.113926 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.114043 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.114237 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.114360 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.114542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.114638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.114848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.114952 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.115159 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.115252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.115487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.115582 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.115825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.115920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.116185 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.116298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.116482 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.116577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.116806 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.116900 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.117124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.117228 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.117447 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.117687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.117816 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.118008 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.118126 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.118343 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.118439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.118673 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.118792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.119004 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.119125 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.119337 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.119444 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.119639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.119746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.119962 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.120068 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.120296 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.120398 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.120606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.120709 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.120922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.121092 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.121237 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.121333 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.121545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.121647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.121866 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.122012 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.122202 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.122293 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.122514 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.122616 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.122832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.122932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.123144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.123239 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.123455 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.123680 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.123779 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.124095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.132188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.132285 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.132418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.132535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.132642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.132739 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.132835 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.132930 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133018 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133104 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133199 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133330 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133557 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133654 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133752 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.133942 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134028 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134115 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134223 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134324 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134602 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134702 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134799 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.134966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135163 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135258 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135353 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135544 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135645 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135904 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.135988 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136209 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136480 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136565 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136659 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.136937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137084 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137173 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137431 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.137985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.138620 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.138620 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.138620 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139856 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.139945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.140038 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.140158 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.140493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.140633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.140823 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.140982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.141149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.141318 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.141486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.141686 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.141822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.142017 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.142159 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.142477 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.142571 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.142804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.142916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.143128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.143235 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.143461 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.143580 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.143795 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.143994 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.144155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.144385 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.144492 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.144757 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.144861 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.145003 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.145112 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.145334 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.145429 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.145654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.145765 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.145973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.146078 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.146290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.146435 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.146607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.146770 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.146925 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.147091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.147240 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.147427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.147554 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.147760 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.147861 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.148078 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.148196 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.148432 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.148538 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.148750 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.149550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.149682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.149774 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.149893 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.149990 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.150223 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.150327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.150535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.150637 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.150853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.150958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.151427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.151540 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.151745 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.151846 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.152058 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.152215 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.152489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.152592 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.152804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.152904 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.153115 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.153208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.153425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.153518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.153743 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.153845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.154071 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.154171 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.154389 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.154490 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.154823 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.154940 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.155081 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.155217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.155393 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.155532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.155663 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.155874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.155979 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.156205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.156320 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.156524 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.156618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.156846 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.156940 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.157170 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.157266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.157483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.157584 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.157805 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.157906 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.158116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.158211 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.158449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.158570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.158786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.158899 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.159110 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.159225 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.159431 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.159708 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.159809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.159895 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.160027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.160154 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.162750 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.162855 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.162944 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163037 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163120 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163342 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163429 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163614 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163709 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163881 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.163974 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.164075 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.164205 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.164284 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.164365 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.164447 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.164572 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.164572 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.165417 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.165493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.165493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.165493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.165493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.165747 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.165822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.165822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.166078 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.166419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.166743 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.167072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.167410 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.167537 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.167725 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.167820 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.168150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.168266 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.168535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.168649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.168797 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.168897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.169111 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.169201 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.169433 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.169539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.169748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.169871 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.170081 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.170358 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.170455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.170687 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.170789 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.171000 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.171123 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.171338 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.171463 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.171661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.171806 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.171986 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.172307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.172582 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.172682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.172912 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.173017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.173234 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.173340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.173566 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.173700 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.173885 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.174117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.174264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.174460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.174564 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.174785 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.174880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.175103 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.175220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.175417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.175522 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.175733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.175846 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.176048 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.176187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.176412 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.176501 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.176742 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.176837 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.177082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.177179 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.177397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.177490 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.177719 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.177819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.178038 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.178133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.178345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.178445 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.178676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.178784 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.178998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.179092 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.179308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.179402 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.179628 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.179742 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.179937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.180028 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.180306 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.180452 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.180635 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.180968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.181058 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.181143 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.181255 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.181384 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.181571 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.181701 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.181884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.182016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.182198 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.182365 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.182516 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.182806 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.182935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.183428 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.183538 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.183631 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.183709 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.183888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.184242 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.184563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.184723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.185788 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.185894 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.185894 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186044 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186044 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186385 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186480 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186597 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.186938 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.187057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.187265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.187366 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.187587 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.187682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.187902 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.187999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.188177 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 16:58:05.188289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.188600 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.188928 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.189249 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.189582 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.189908 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.190229 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.190556 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.190870 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.191459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.191825 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.192169 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.192518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.192849 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.193327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.193488 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.193827 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.194142 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.194453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.194773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.195090 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.195401 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.195728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.196054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.196397 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.196708 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.197065 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.197362 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.197695 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.198006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.198317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.198628 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.198944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.199253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.199561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.199871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.200202 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.200520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.200829 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.201141 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.201456 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.201770 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.202274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.202394 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.202737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.203070 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.203378 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.203686 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.204005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.204346 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.204673 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.208739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.208739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.208739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.208739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.208739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.208739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.208739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.208739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.209391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.209391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.209391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.209391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.209391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.209391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.209843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.209843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.210163 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.210478 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.210794 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.211108 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.211945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.212282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.212598 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.212913 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.213228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.213584 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.214529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.214529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.214724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.214954 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.215276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.215628 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.215914 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.216254 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.216570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.216885 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.217205 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.217545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.219381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.219381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.219381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.219381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.219381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.219814 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.219916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.220265 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.220596 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.220910 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.221238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.221551 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.221891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.222238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.222562 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.222888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.223197 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.223505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.223811 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.224172 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.224492 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.224805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.225112 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.225417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.225728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.226062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.226370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.226675 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.227000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.227880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.228211 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.228523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.228831 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.229140 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.229448 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.229753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.230062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.230398 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.230710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.231018 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.231324 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.231627 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.231959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.232322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.232639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.232964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.233279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.233603 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.233920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.234246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.234567 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.234887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.235189 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.235523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.235835 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.236207 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.236524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.236839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.237151 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.237465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.237801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.238129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.238439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.238765 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.239084 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.239407 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.239724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.240040 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.243966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.244131 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.244653 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.245117 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.245472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.245805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.246124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.246442 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.246752 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:58:05.246999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 16:58:05.253363 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO dbcounter [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Registered counter for database nova_api Jun 22 16:58:05.274731 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_db.sqlalchemy.engines [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:58:05.283321 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writer thread running {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:58:05.311654 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO dbcounter [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Registered counter for database nova_api Jun 22 16:58:05.332719 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_db.sqlalchemy.engines [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:58:05.342712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writer thread running {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:58:05.345669 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.context [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),889b0550-a155-4c00-a285-69151626d4f5(cell1) {{(pid=118471) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 16:58:05.349831 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:58:05.351442 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:58:05.352319 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:58:05.354427 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:58:05.356486 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO dbcounter [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Registered counter for database nova_cell0 Jun 22 16:58:05.360650 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO dbcounter [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Registered counter for database nova_cell1 Jun 22 16:58:05.367947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_db.sqlalchemy.engines [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:58:05.371502 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_db.sqlalchemy.engines [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:58:05.377917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writer thread running {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:58:05.379516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writer thread running {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:58:05.402454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.context [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),889b0550-a155-4c00-a285-69151626d4f5(cell1) {{(pid=118472) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 16:58:05.406679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:58:05.408288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:58:05.409109 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:58:05.411062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:58:05.413106 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO dbcounter [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Registered counter for database nova_cell0 Jun 22 16:58:05.417325 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO dbcounter [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Registered counter for database nova_cell1 Jun 22 16:58:05.424637 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_db.sqlalchemy.engines [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:58:05.427110 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_db.sqlalchemy.engines [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:58:05.434181 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writer thread running {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:58:05.435461 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writer thread running {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:58:05.530081 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO dbcounter [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Registered counter for database nova_cell0 Jun 22 16:58:05.537808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_db.sqlalchemy.engines [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:58:05.542188 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writer thread running {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:58:05.584518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO dbcounter [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Registered counter for database nova_cell0 Jun 22 16:58:05.591831 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_db.sqlalchemy.engines [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:58:05.596081 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writer thread running {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:58:05.874172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: WARNING keystonemiddleware.auth_token [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 16:58:05.881475 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: WARNING keystonemiddleware.auth_token [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 16:58:05.921036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: WARNING keystonemiddleware.auth_token [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 16:58:05.928363 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: WARNING keystonemiddleware.auth_token [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 16:58:06.228955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: WARNING keystonemiddleware.auth_token [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 16:58:06.234901 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: WARNING keystonemiddleware.auth_token [None req-31f00a3b-5a74-4816-8e3a-acd272c85347 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 16:58:06.240648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6c5bf29c0 pid: 118471 (default app) Jun 22 16:58:06.286437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: WARNING keystonemiddleware.auth_token [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 16:58:06.292627 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: WARNING keystonemiddleware.auth_token [None req-a1db329c-7b82-4efc-ae03-12431c46fb4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 16:58:06.298000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6c5bf29c0 pid: 118472 (default app) Jun 22 16:58:46.210324 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:46.211960 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:46.212880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:46.213659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.302977 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.302977 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.303728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.304256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.432651 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-222a353d-f7a9-4139-b0e7-93a54ed49a02 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Action: 'create', calling method: .version_select at 0x7fe0a24e6790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2069269275", "metadata": {"Type": "work"}}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-222a353d-f7a9-4139-b0e7-93a54ed49a02 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Request method failure captured: Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 122 Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pGgZYI-SK6oIq0foJZfdEcN0fnZCL6eEnWu4cnnNA7F_pHaPwk6oHno0WCZZ7kKvhmbOvhqj41cBWxvo4BhMDzBXY-sFLqoYGy_ux3HBXAvIia_B_JmiEFE5YRdW-ebC149VSve7nNOz5HH9jBE_Yuihb0X5MKpN81y7X1AfP0hOg Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 16:58:47.466001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 1007c1456cea4882aa4e6bd90ca1d89c Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2069269275", "metadata": {"Type": "work"}}} Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: Jun 22 16:58:47.467374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2069269275', 'metadata': {'Type': 'work'}}}} Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise error Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:58:47.473917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 16:58:47.476732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 16:58:47.479699 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 16:58:47.479699 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.479699 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-222a353d-f7a9-4139-b0e7-93a54ed49a02 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:58:47.479699 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-222a353d-f7a9-4139-b0e7-93a54ed49a02 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.272798 Jun 22 16:58:47.479699 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 22 16:58:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 16:58:47.483260 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0378f90c-bc03-483f-a99a-888dc25249df tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Action: 'create', calling method: .version_select at 0x7fe0a2464a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1991822243", "metadata": {"Type": "work"}}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0378f90c-bc03-483f-a99a-888dc25249df tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Request method failure captured: Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 120 Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pGgZYI-SK6oIq0foJZfdEcN0fnZCL6eEnWu4cnnNA7F_pHaPwk6oHno0WCZZ7kKvhmbOvhqj41cBWxvo4BhMDzBXY-sFLqoYGy_ux3HBXAvIia_B_JmiEFE5YRdW-ebC149VSve7nNOz5HH9jBE_Yuihb0X5MKpN81y7X1AfP0hOg Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 16:58:47.485883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 1007c1456cea4882aa4e6bd90ca1d89c Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1991822243", "metadata": {"Type": "work"}}} Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: Jun 22 16:58:47.487830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1991822243', 'metadata': {'Type': 'work'}}}} Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise error Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi '0' Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:58:47.489007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 16:58:47.491028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 16:58:47.494904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 16:58:47.494904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.494904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0378f90c-bc03-483f-a99a-888dc25249df tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:58:47.494904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0378f90c-bc03-483f-a99a-888dc25249df tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008394 Jun 22 16:58:47.494904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 22 16:58:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 16:58:47.497335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-abc5d716-9e4c-4bd9-9481-95bda72550af tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Action: 'create', calling method: .version_select at 0x7fe0a24e6af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-619133714", "metadata": {"Type": "work"}}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-abc5d716-9e4c-4bd9-9481-95bda72550af tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Request method failure captured: Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 118 Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pGgZYI-SK6oIq0foJZfdEcN0fnZCL6eEnWu4cnnNA7F_pHaPwk6oHno0WCZZ7kKvhmbOvhqj41cBWxvo4BhMDzBXY-sFLqoYGy_ux3HBXAvIia_B_JmiEFE5YRdW-ebC149VSve7nNOz5HH9jBE_Yuihb0X5MKpN81y7X1AfP0hOg Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 16:58:47.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 1007c1456cea4882aa4e6bd90ca1d89c Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-619133714", "metadata": {"Type": "work"}}} Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: Jun 22 16:58:47.505948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-619133714', 'metadata': {'Type': 'work'}}}} Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise error Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi '' Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:58:47.507134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 16:58:47.511418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 16:58:47.514084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 16:58:47.514084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:47.514084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-abc5d716-9e4c-4bd9-9481-95bda72550af tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:58:47.514084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-abc5d716-9e4c-4bd9-9481-95bda72550af tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007166 Jun 22 16:58:47.514084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 22 16:58:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 16:58:47.514084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-69a33308-1f4e-46c5-829a-0a8633ccac8e tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Calling method '.version_select at 0x7fe0a2390790>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:48.704911 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-69a33308-1f4e-46c5-829a-0a8633ccac8e tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] HTTP exception thrown: Volume tempest-invalid-2017383923 could not be found. Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-69a33308-1f4e-46c5-829a-0a8633ccac8e tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Request method failure captured: Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2017383923 HTTP/1.1 Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pGgZYI-SK6oIq0foJZfdEcN0fnZCL6eEnWu4cnnNA7F_pHaPwk6oHno0WCZZ7kKvhmbOvhqj41cBWxvo4BhMDzBXY-sFLqoYGy_ux3HBXAvIia_B_JmiEFE5YRdW-ebC149VSve7nNOz5HH9jBE_Yuihb0X5MKpN81y7X1AfP0hOg Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 16:58:48.714666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 1007c1456cea4882aa4e6bd90ca1d89c Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Volume tempest-invalid-2017383923 could not be found. Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': 'tempest-invalid-2017383923'} Jun 22 16:58:48.715893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2017383923 could not be found. (HTTP 404) (Request-ID: req-e57cd0bc-e493-4de7-8dec-3af932bc690c) Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:48.716764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 16:58:48.717943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2017383923 could not be found. Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:58:48.719112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2017383923 could not be found. Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2017383923 could not be found. Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-69a33308-1f4e-46c5-829a-0a8633ccac8e tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Returning 404 to user: Volume tempest-invalid-2017383923 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:58:48.722608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-69a33308-1f4e-46c5-829a-0a8633ccac8e tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2017383923" status: 404 len: 99 microversion: 2.1 time: 1.209257 Jun 22 16:58:48.728453 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 4/4] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 22 16:58:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2017383923 => generated 99 bytes in 1221 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 16:58:48.738169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-71501d4c-2b2e-4903-b520-961fc3716a39 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007032 Jun 22 16:58:48.748132 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Jun 22 16:58:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 16:58:48.757101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-18bdf41d-5614-4842-af1a-7e965ce01100 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006756 Jun 22 16:58:48.766393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1136 bytes} [Wed Jun 22 16:58:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 16:58:48.782605 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ebcf28d3-6ef8-4875-9341-e2f19d446ab0 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Calling method '.version_select at 0x7fe0a2343a60>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:48.869738 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a0849936-a2be-4e19-a54a-43d246705a2c tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Action: 'create', calling method: .version_select at 0x7fe0a24e5790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-409846419", "metadata": {"Type": "work"}}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:58:48.926909 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-ebcf28d3-6ef8-4875-9341-e2f19d446ab0 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] HTTP exception thrown: Volume 92e48d72-a46c-404c-a6e8-33ba68a068e9 could not be found. Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ebcf28d3-6ef8-4875-9341-e2f19d446ab0 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Request method failure captured: Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: DELETE /compute/v2.1/os-volumes/92e48d72-a46c-404c-a6e8-33ba68a068e9 HTTP/1.1 Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pGgZYI-SK6oIq0foJZfdEcN0fnZCL6eEnWu4cnnNA7F_pHaPwk6oHno0WCZZ7kKvhmbOvhqj41cBWxvo4BhMDzBXY-sFLqoYGy_ux3HBXAvIia_B_JmiEFE5YRdW-ebC149VSve7nNOz5HH9jBE_Yuihb0X5MKpN81y7X1AfP0hOg Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 16:58:48.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 1007c1456cea4882aa4e6bd90ca1d89c Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Volume 92e48d72-a46c-404c-a6e8-33ba68a068e9 could not be found. Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '92e48d72-a46c-404c-a6e8-33ba68a068e9'} Jun 22 16:58:48.935234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92e48d72-a46c-404c-a6e8-33ba68a068e9 could not be found. (HTTP 404) (Request-ID: req-1a5e6d06-7849-4e4d-8e7f-9ddbd943f32a) Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:48.936040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 16:58:48.937230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92e48d72-a46c-404c-a6e8-33ba68a068e9 could not be found. Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 16:58:48.939705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92e48d72-a46c-404c-a6e8-33ba68a068e9 could not be found. Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92e48d72-a46c-404c-a6e8-33ba68a068e9 could not be found. Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ebcf28d3-6ef8-4875-9341-e2f19d446ab0 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Returning 404 to user: Volume 92e48d72-a46c-404c-a6e8-33ba68a068e9 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:58:48.942531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ebcf28d3-6ef8-4875-9341-e2f19d446ab0 tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/92e48d72-a46c-404c-a6e8-33ba68a068e9" status: 404 len: 109 microversion: 2.1 time: 0.169902 Jun 22 16:58:48.944871 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 7/7] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 16:58:48 2022] DELETE /compute/v2.1/os-volumes/92e48d72-a46c-404c-a6e8-33ba68a068e9 => generated 109 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 16:58:48.961702 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3d00b5cc-8d2f-4299-aeba-eaa4ee261fed tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Calling method '.version_select at 0x7fe0a23435e0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:49.000975 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-3d00b5cc-8d2f-4299-aeba-eaa4ee261fed tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] HTTP exception thrown: Volume a8999a77-7ec3-41c5-971e-b61c8c0a9e8b could not be found. Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3d00b5cc-8d2f-4299-aeba-eaa4ee261fed tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Request method failure captured: Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/os-volumes/a8999a77-7ec3-41c5-971e-b61c8c0a9e8b HTTP/1.1 Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pGgZYI-SK6oIq0foJZfdEcN0fnZCL6eEnWu4cnnNA7F_pHaPwk6oHno0WCZZ7kKvhmbOvhqj41cBWxvo4BhMDzBXY-sFLqoYGy_ux3HBXAvIia_B_JmiEFE5YRdW-ebC149VSve7nNOz5HH9jBE_Yuihb0X5MKpN81y7X1AfP0hOg Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 16:58:49.014768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f50acc4ac39b4ca79a57dd26b61b4b09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: f50acc4ac39b4ca79a57dd26b61b4b09 Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesNegativeTest-165356910 Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 1007c1456cea4882aa4e6bd90ca1d89c Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesNegativeTest-165356910-project Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Volume a8999a77-7ec3-41c5-971e-b61c8c0a9e8b could not be found. Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': 'a8999a77-7ec3-41c5-971e-b61c8c0a9e8b'} Jun 22 16:58:49.016411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a8999a77-7ec3-41c5-971e-b61c8c0a9e8b could not be found. (HTTP 404) (Request-ID: req-658ca3a7-8681-419b-82b8-6858f2f66a0e) Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:49.017372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 16:58:49.018730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a8999a77-7ec3-41c5-971e-b61c8c0a9e8b could not be found. Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 16:58:49.020016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a8999a77-7ec3-41c5-971e-b61c8c0a9e8b could not be found. Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a8999a77-7ec3-41c5-971e-b61c8c0a9e8b could not be found. Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3d00b5cc-8d2f-4299-aeba-eaa4ee261fed tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] Returning 404 to user: Volume a8999a77-7ec3-41c5-971e-b61c8c0a9e8b could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3d00b5cc-8d2f-4299-aeba-eaa4ee261fed tempest-VolumesNegativeTest-165356910 tempest-VolumesNegativeTest-165356910-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a8999a77-7ec3-41c5-971e-b61c8c0a9e8b" status: 404 len: 109 microversion: 2.1 time: 0.050776 Jun 22 16:58:49.021488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 8/8] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 16:58:48 2022] GET /compute/v2.1/os-volumes/a8999a77-7ec3-41c5-971e-b61c8c0a9e8b => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 16:58:51.892762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a0849936-a2be-4e19-a54a-43d246705a2c tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.601373 Jun 22 16:58:51.893889 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 1/9] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 22 16:58:47 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4604 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 16:58:51.907920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ea39f41f-2cf5-4929-8e81-964c45e79e55 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Calling method '.version_select at 0x7fe0a2464dc0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:52.211311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ea39f41f-2cf5-4929-8e81-964c45e79e55 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603" status: 200 len: 352 microversion: 2.1 time: 0.308629 Jun 22 16:58:52.213163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 9/10] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 16:58:51 2022] GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603 => generated 352 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:58:53.227765 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7a4aa0a-1b2f-4f32-bb29-4dc9866e0ad3 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Calling method '.version_select at 0x7fe0a23af5e0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:53.457801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7a4aa0a-1b2f-4f32-bb29-4dc9866e0ad3 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603" status: 200 len: 353 microversion: 2.1 time: 0.236260 Jun 22 16:58:53.458365 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 2/11] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 16:58:53 2022] GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603 => generated 353 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:58:53.479873 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1ca9de4e-5465-4e40-bcab-c8d89f615039 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Calling method '.version_select at 0x7fe0a24e69d0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:53.763803 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1ca9de4e-5465-4e40-bcab-c8d89f615039 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603" status: 200 len: 353 microversion: 2.1 time: 0.297281 Jun 22 16:58:53.764535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 10/12] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 16:58:53 2022] GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603 => generated 353 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:58:53.781588 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b181cb09-8bf2-4efc-8225-1975eaa422df tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Calling method '.version_select at 0x7fe0a23af700>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:54.167705 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b181cb09-8bf2-4efc-8225-1975eaa422df tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603" status: 202 len: 0 microversion: 2.1 time: 0.390084 Jun 22 16:58:54.169082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 3/13] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 16:58:53 2022] DELETE /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 16:58:54.183796 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0562e207-c756-42f4-ac0c-6c1744d55e26 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Calling method '.version_select at 0x7fe0a2343310>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:54.307991 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0562e207-c756-42f4-ac0c-6c1744d55e26 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603" status: 200 len: 352 microversion: 2.1 time: 0.134177 Jun 22 16:58:54.311194 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 11/14] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 16:58:54 2022] GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:58:55.321618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-49b2fc72-03d6-4d59-a6d4-42aebefb29e2 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Calling method '.version_select at 0x7fe0a23afd30>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:58:56.061334 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-49b2fc72-03d6-4d59-a6d4-42aebefb29e2 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] HTTP exception thrown: Volume bf6612de-d1a9-48ef-a9ff-a9eff9002603 could not be found. Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-49b2fc72-03d6-4d59-a6d4-42aebefb29e2 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Request method failure captured: Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603 HTTP/1.1 Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0pH1IJgNbYDs8iTE3LzHfgoazkKYYdv8zCBj073IuTQTbPAL3Qql76bL4f4hXUO-vCVhrwm6v8nVcu1crI6qtJVoFY2wTE9qC493AQV8DR_I9xXCPrTrJcloiC7YhyOSfoC3SuSOqQODgikxG01yfxhpVbuCBi_GC3-UK0k6Qhg4js Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 99922f0daf4149d7b7de8c025b0a87a4 Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesGetTestJSON-1987986465 Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 16:58:56.072145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/99922f0daf4149d7b7de8c025b0a87a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_99922f0daf4149d7b7de8c025b0a87a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/99922f0daf4149d7b7de8c025b0a87a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/99922f0daf4149d7b7de8c025b0a87a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesGetTestJSON-1987986465 Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 99922f0daf4149d7b7de8c025b0a87a4 Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesGetTestJSON-1987986465 Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesGetTestJSON-1987986465-project Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 647a2374cc434c289563881347578a1f Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesGetTestJSON-1987986465-project Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Volume bf6612de-d1a9-48ef-a9ff-a9eff9002603 could not be found. Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': 'bf6612de-d1a9-48ef-a9ff-a9eff9002603'} Jun 22 16:58:56.077579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf6612de-d1a9-48ef-a9ff-a9eff9002603 could not be found. (HTTP 404) (Request-ID: req-44ba21f9-d709-4ad3-942e-dfbd78d670ae) Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:56.078472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 16:58:56.080361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf6612de-d1a9-48ef-a9ff-a9eff9002603 could not be found. Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 16:58:56.084452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf6612de-d1a9-48ef-a9ff-a9eff9002603 could not be found. Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf6612de-d1a9-48ef-a9ff-a9eff9002603 could not be found. Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-49b2fc72-03d6-4d59-a6d4-42aebefb29e2 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] Returning 404 to user: Volume bf6612de-d1a9-48ef-a9ff-a9eff9002603 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 16:58:56.086618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-49b2fc72-03d6-4d59-a6d4-42aebefb29e2 tempest-VolumesGetTestJSON-1987986465 tempest-VolumesGetTestJSON-1987986465-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603" status: 404 len: 109 microversion: 2.1 time: 0.756756 Jun 22 16:58:56.089788 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 4/15] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 16:58:55 2022] GET /compute/v2.1/os-volumes/bf6612de-d1a9-48ef-a9ff-a9eff9002603 => generated 109 bytes in 759 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 16:58:58.125029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-541748535", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "networks": [{"uuid": "3adc836a-9035-4801-93a3-e8e70e27f453"}]}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:58:58.312165 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1949149557", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:58:58.354165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] validate_networks() for [('3adc836a-9035-4801-93a3-e8e70e27f453', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 16:58:58.544674 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] validate_networks() for [('260e6a41-6ed6-45a7-8ce9-f798c1704919', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 16:58:59.601102 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 16:58:59.602228 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 16:58:59.603941 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 16:58:59.604540 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 16:58:59.605117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 16:58:59.631374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:58:59.637007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:58:59.638104 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:58:59.638692 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:58:59.715970 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Getting quotas for project 85dd6bf936e34faf84e53d142768a560. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 16:58:59.745829 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Getting quotas for user 575996511c464f37a8ab2c4369b29699 and project 85dd6bf936e34faf84e53d142768a560. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 16:58:59.785343 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 16:58:59.791316 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 16:58:59.946089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 16:58:59.946594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 16:58:59.946971 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 16:58:59.947376 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 16:58:59.947895 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 16:58:59.965798 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:58:59.966249 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:58:59.967039 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:58:59.967467 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:00.014910 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Getting quotas for project 47bd5d8cddc94945b967b114d49f086c. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 16:59:00.032886 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Getting quotas for user 276147f205ae43da9df678dcd572115a and project 47bd5d8cddc94945b967b114d49f086c. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 16:59:00.050543 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-906d687b-3503-40d9-8378-4cbca4eaf526 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.266964 Jun 22 16:59:00.056627 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 16:59:00.057541 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 12/16] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 16:58:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 16:59:00.061105 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 16:59:00.070653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fb34b8cc-a465-420a-8dd5-4a12d3d40b03 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:00.078240 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fb34b8cc-a465-420a-8dd5-4a12d3d40b03 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:00.252124 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fb34b8cc-a465-420a-8dd5-4a12d3d40b03 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:00.277385 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fb34b8cc-a465-420a-8dd5-4a12d3d40b03 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1214 microversion: 2.1 time: 0.213147 Jun 22 16:59:00.278153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 13/17] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:00 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:00.360917 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6ace849f-4d59-4be1-b2d3-77557bbdeecd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.166076 Jun 22 16:59:00.367511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 5/18] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 16:58:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 16:59:00.383577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f4def038-950a-4884-9c6c-115344bfef63 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:00.384825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f4def038-950a-4884-9c6c-115344bfef63 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:00.529144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f4def038-950a-4884-9c6c-115344bfef63 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:00.537157 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f4def038-950a-4884-9c6c-115344bfef63 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1222 microversion: 2.1 time: 0.168273 Jun 22 16:59:00.544979 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 14/19] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:00 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:00.847347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1447553445", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:59:00.974522 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] validate_networks() for [('260e6a41-6ed6-45a7-8ce9-f798c1704919', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 16:59:01.298516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-28983ccd-1bb8-41ca-be15-27884732987b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:01.299143 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-28983ccd-1bb8-41ca-be15-27884732987b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:01.397598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-28983ccd-1bb8-41ca-be15-27884732987b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:01.405588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-28983ccd-1bb8-41ca-be15-27884732987b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1214 microversion: 2.1 time: 0.114549 Jun 22 16:59:01.419857 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 15/20] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:01 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:01.655327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 16:59:01.655851 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 16:59:01.656308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 16:59:01.656718 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 16:59:01.657128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 16:59:01.666312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:01.666750 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:01.667543 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:01.667971 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:01.717089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Getting quotas for project 47bd5d8cddc94945b967b114d49f086c. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 16:59:01.723699 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Getting quotas for user 276147f205ae43da9df678dcd572115a and project 47bd5d8cddc94945b967b114d49f086c. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 16:59:01.737616 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 16:59:01.741305 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 16:59:01.921016 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bd883c1b-be75-4066-80f8-b0552563cf84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.087129 Jun 22 16:59:01.921853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 6/21] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 16:59:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 16:59:01.933085 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-29fb2c02-ea19-4de2-99a4-160a830b1563 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:01.933712 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-29fb2c02-ea19-4de2-99a4-160a830b1563 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:02.354550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-29fb2c02-ea19-4de2-99a4-160a830b1563 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:02.367278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-29fb2c02-ea19-4de2-99a4-160a830b1563 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1222 microversion: 2.1 time: 0.434129 Jun 22 16:59:02.378324 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 16/22] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:01 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1222 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:02.428279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-98a1e4c8-edbf-4006-aa39-e9399e472930 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:02.428899 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-98a1e4c8-edbf-4006-aa39-e9399e472930 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:02.612053 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-98a1e4c8-edbf-4006-aa39-e9399e472930 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:02.657261 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-98a1e4c8-edbf-4006-aa39-e9399e472930 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1214 microversion: 2.1 time: 0.234619 Jun 22 16:59:02.664151 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 7/23] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:02 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:03.385196 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-779f2594-dcb1-4f3e-bad3-433251bfd218 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:03.386681 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-779f2594-dcb1-4f3e-bad3-433251bfd218 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:03.472762 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-779f2594-dcb1-4f3e-bad3-433251bfd218 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:03.486440 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-779f2594-dcb1-4f3e-bad3-433251bfd218 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1222 microversion: 2.1 time: 0.103070 Jun 22 16:59:03.486440 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 17/24] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:03 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:03.682332 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-30df4f57-441b-4fec-8efd-60998323f56e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:03.683145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-30df4f57-441b-4fec-8efd-60998323f56e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:03.699811 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-30df4f57-441b-4fec-8efd-60998323f56e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:03.700305 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-30df4f57-441b-4fec-8efd-60998323f56e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:03.702753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-30df4f57-441b-4fec-8efd-60998323f56e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:03.703209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-30df4f57-441b-4fec-8efd-60998323f56e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:03.972909 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-30df4f57-441b-4fec-8efd-60998323f56e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:03.989543 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-30df4f57-441b-4fec-8efd-60998323f56e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1218 microversion: 2.1 time: 0.312653 Jun 22 16:59:03.990266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 8/25] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:03 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1218 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:04.501903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f57ebffb-1e53-4608-81d1-ec8cb16c8b11 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:04.502620 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f57ebffb-1e53-4608-81d1-ec8cb16c8b11 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:04.511097 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f57ebffb-1e53-4608-81d1-ec8cb16c8b11 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:04.512085 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f57ebffb-1e53-4608-81d1-ec8cb16c8b11 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:04.513157 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f57ebffb-1e53-4608-81d1-ec8cb16c8b11 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:04.513880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f57ebffb-1e53-4608-81d1-ec8cb16c8b11 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:04.678654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f57ebffb-1e53-4608-81d1-ec8cb16c8b11 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:04.690472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f57ebffb-1e53-4608-81d1-ec8cb16c8b11 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1226 microversion: 2.1 time: 0.192575 Jun 22 16:59:04.691049 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 18/26] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:04 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1226 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:05.006772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-513cfc81-95be-4e6d-8093-12acccb0f54a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:05.007437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-513cfc81-95be-4e6d-8093-12acccb0f54a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:05.020361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-513cfc81-95be-4e6d-8093-12acccb0f54a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:05.020824 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-513cfc81-95be-4e6d-8093-12acccb0f54a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:05.021618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-513cfc81-95be-4e6d-8093-12acccb0f54a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:05.022061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-513cfc81-95be-4e6d-8093-12acccb0f54a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:05.100441 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-513cfc81-95be-4e6d-8093-12acccb0f54a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:05.111890 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-513cfc81-95be-4e6d-8093-12acccb0f54a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1218 microversion: 2.1 time: 0.108912 Jun 22 16:59:05.126081 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 9/27] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:05 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:05.707946 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7e80ed00-e147-4b70-847f-5bf604de7942 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:05.708605 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7e80ed00-e147-4b70-847f-5bf604de7942 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:05.715176 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7e80ed00-e147-4b70-847f-5bf604de7942 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:05.715466 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7e80ed00-e147-4b70-847f-5bf604de7942 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:05.716261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7e80ed00-e147-4b70-847f-5bf604de7942 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:05.716739 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7e80ed00-e147-4b70-847f-5bf604de7942 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:05.805888 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7e80ed00-e147-4b70-847f-5bf604de7942 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:05.813177 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7e80ed00-e147-4b70-847f-5bf604de7942 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1218 microversion: 2.1 time: 0.110337 Jun 22 16:59:05.813749 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 19/28] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:05 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:06.130879 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72696a6c-4216-44ff-90dd-63433c1dd495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:06.131901 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-72696a6c-4216-44ff-90dd-63433c1dd495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:06.143155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72696a6c-4216-44ff-90dd-63433c1dd495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:06.144808 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72696a6c-4216-44ff-90dd-63433c1dd495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:06.146403 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72696a6c-4216-44ff-90dd-63433c1dd495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:06.148521 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72696a6c-4216-44ff-90dd-63433c1dd495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:06.255705 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-72696a6c-4216-44ff-90dd-63433c1dd495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:06.261642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-72696a6c-4216-44ff-90dd-63433c1dd495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1266 microversion: 2.1 time: 0.136281 Jun 22 16:59:06.262452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 10/29] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:06 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:06.830822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d0879d00-5782-401a-8582-5ee910f3a043 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:06.831508 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d0879d00-5782-401a-8582-5ee910f3a043 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:06.837551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d0879d00-5782-401a-8582-5ee910f3a043 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:06.838075 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d0879d00-5782-401a-8582-5ee910f3a043 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:06.838901 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d0879d00-5782-401a-8582-5ee910f3a043 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:06.839404 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d0879d00-5782-401a-8582-5ee910f3a043 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:06.908844 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d0879d00-5782-401a-8582-5ee910f3a043 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:06.917441 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d0879d00-5782-401a-8582-5ee910f3a043 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1274 microversion: 2.1 time: 0.090593 Jun 22 16:59:06.918005 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 20/30] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:06 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:07.294554 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8e07851e-ff9b-4121-98f5-f1bc8cf8f3ce tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:07.295166 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8e07851e-ff9b-4121-98f5-f1bc8cf8f3ce tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:07.302955 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e07851e-ff9b-4121-98f5-f1bc8cf8f3ce tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:07.303888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e07851e-ff9b-4121-98f5-f1bc8cf8f3ce tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:07.305255 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e07851e-ff9b-4121-98f5-f1bc8cf8f3ce tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:07.306616 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e07851e-ff9b-4121-98f5-f1bc8cf8f3ce tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:07.392405 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8e07851e-ff9b-4121-98f5-f1bc8cf8f3ce tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:07.402870 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8e07851e-ff9b-4121-98f5-f1bc8cf8f3ce tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1266 microversion: 2.1 time: 0.116597 Jun 22 16:59:07.412243 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 11/31] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:07 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:07.935292 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a5735d3e-706f-4b72-9eda-5ac2fd298dd9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:07.937087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a5735d3e-706f-4b72-9eda-5ac2fd298dd9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:07.943631 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5735d3e-706f-4b72-9eda-5ac2fd298dd9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:07.944139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5735d3e-706f-4b72-9eda-5ac2fd298dd9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:07.945121 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5735d3e-706f-4b72-9eda-5ac2fd298dd9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:07.945704 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5735d3e-706f-4b72-9eda-5ac2fd298dd9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:08.017357 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a5735d3e-706f-4b72-9eda-5ac2fd298dd9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:08.025492 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a5735d3e-706f-4b72-9eda-5ac2fd298dd9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1274 microversion: 2.1 time: 0.094483 Jun 22 16:59:08.026313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 21/32] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:07 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:08.420345 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-15c5d5bf-da02-407e-a714-dd97b29ca299 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:08.420998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-15c5d5bf-da02-407e-a714-dd97b29ca299 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:08.427094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-15c5d5bf-da02-407e-a714-dd97b29ca299 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:08.427543 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-15c5d5bf-da02-407e-a714-dd97b29ca299 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:08.428352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-15c5d5bf-da02-407e-a714-dd97b29ca299 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:08.428788 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-15c5d5bf-da02-407e-a714-dd97b29ca299 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:08.496214 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-15c5d5bf-da02-407e-a714-dd97b29ca299 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:08.504396 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-15c5d5bf-da02-407e-a714-dd97b29ca299 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1266 microversion: 2.1 time: 0.087415 Jun 22 16:59:08.514817 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 12/33] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:08 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:09.042397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4dfd5162-78a7-40cf-877c-06ecd45cb75c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:09.042999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4dfd5162-78a7-40cf-877c-06ecd45cb75c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:09.049177 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4dfd5162-78a7-40cf-877c-06ecd45cb75c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:09.049624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4dfd5162-78a7-40cf-877c-06ecd45cb75c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:09.050428 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4dfd5162-78a7-40cf-877c-06ecd45cb75c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:09.050853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4dfd5162-78a7-40cf-877c-06ecd45cb75c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:09.137822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4dfd5162-78a7-40cf-877c-06ecd45cb75c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:09.145274 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4dfd5162-78a7-40cf-877c-06ecd45cb75c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1274 microversion: 2.1 time: 0.106709 Jun 22 16:59:09.145911 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 22/34] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:09 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:09.536246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f006313c-b981-4003-b04f-0fba0ce99b18 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:09.536857 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f006313c-b981-4003-b04f-0fba0ce99b18 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:09.543308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f006313c-b981-4003-b04f-0fba0ce99b18 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:09.543753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f006313c-b981-4003-b04f-0fba0ce99b18 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:09.544561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f006313c-b981-4003-b04f-0fba0ce99b18 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:09.545049 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f006313c-b981-4003-b04f-0fba0ce99b18 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:09.769087 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f006313c-b981-4003-b04f-0fba0ce99b18 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:09.779441 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f006313c-b981-4003-b04f-0fba0ce99b18 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1266 microversion: 2.1 time: 0.246759 Jun 22 16:59:09.780674 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 13/35] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:09 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:10.164689 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-857de4e5-b8d1-4b10-91d5-fac929d687a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:10.165487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-857de4e5-b8d1-4b10-91d5-fac929d687a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:10.168651 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:10.176768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-857de4e5-b8d1-4b10-91d5-fac929d687a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:10.177223 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-857de4e5-b8d1-4b10-91d5-fac929d687a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:10.188466 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-857de4e5-b8d1-4b10-91d5-fac929d687a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:10.189027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-857de4e5-b8d1-4b10-91d5-fac929d687a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:10.308576 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-857de4e5-b8d1-4b10-91d5-fac929d687a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:10.326200 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-857de4e5-b8d1-4b10-91d5-fac929d687a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1274 microversion: 2.1 time: 0.166677 Jun 22 16:59:10.327220 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 23/36] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:10 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:10.799764 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-33d8150a-33f2-4e58-93d6-811eccee0c39 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:10.800419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-33d8150a-33f2-4e58-93d6-811eccee0c39 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:10.807311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-33d8150a-33f2-4e58-93d6-811eccee0c39 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:10.817441 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-33d8150a-33f2-4e58-93d6-811eccee0c39 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:10.819267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-33d8150a-33f2-4e58-93d6-811eccee0c39 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:10.824757 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-33d8150a-33f2-4e58-93d6-811eccee0c39 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:10.984766 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-33d8150a-33f2-4e58-93d6-811eccee0c39 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:10.996281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-33d8150a-33f2-4e58-93d6-811eccee0c39 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1272 microversion: 2.1 time: 0.200532 Jun 22 16:59:10.997019 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 14/37] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:10 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:11.344653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3715b80e-5d41-4d0c-ac0b-0e1cbe32c487 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:11.346091 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3715b80e-5d41-4d0c-ac0b-0e1cbe32c487 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:11.358483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3715b80e-5d41-4d0c-ac0b-0e1cbe32c487 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:11.359155 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3715b80e-5d41-4d0c-ac0b-0e1cbe32c487 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:11.360772 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3715b80e-5d41-4d0c-ac0b-0e1cbe32c487 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:11.361547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3715b80e-5d41-4d0c-ac0b-0e1cbe32c487 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:11.451625 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3715b80e-5d41-4d0c-ac0b-0e1cbe32c487 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:11.465265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3715b80e-5d41-4d0c-ac0b-0e1cbe32c487 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1280 microversion: 2.1 time: 0.125136 Jun 22 16:59:11.468511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 24/38] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:11 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:12.023446 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8a5a8a69-aace-4219-85f5-583d0a18e095 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:12.024962 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8a5a8a69-aace-4219-85f5-583d0a18e095 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:12.038816 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:12.041619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a5a8a69-aace-4219-85f5-583d0a18e095 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:12.041959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a5a8a69-aace-4219-85f5-583d0a18e095 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:12.046035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a5a8a69-aace-4219-85f5-583d0a18e095 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:12.046809 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a5a8a69-aace-4219-85f5-583d0a18e095 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:12.493794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-49292a89-5662-44d6-a321-4c2a52e2e3ba tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:12.496959 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-49292a89-5662-44d6-a321-4c2a52e2e3ba tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:12.516513 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-49292a89-5662-44d6-a321-4c2a52e2e3ba tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:12.522132 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-49292a89-5662-44d6-a321-4c2a52e2e3ba tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:12.527144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-49292a89-5662-44d6-a321-4c2a52e2e3ba tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:12.537413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-49292a89-5662-44d6-a321-4c2a52e2e3ba tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:12.649003 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=14 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:12.997321 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-49292a89-5662-44d6-a321-4c2a52e2e3ba tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:13.006480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-49292a89-5662-44d6-a321-4c2a52e2e3ba tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.524465 Jun 22 16:59:13.011219 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 25/39] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:12 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:13.580353 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8a5a8a69-aace-4219-85f5-583d0a18e095 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:13.592859 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8a5a8a69-aace-4219-85f5-583d0a18e095 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 1.570009 Jun 22 16:59:13.593632 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 15/40] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:12 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:14.025306 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=16 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:14.034402 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4d719199-6748-46a2-997d-931aa352fb1e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:14.035021 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4d719199-6748-46a2-997d-931aa352fb1e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:14.068356 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4d719199-6748-46a2-997d-931aa352fb1e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:14.068974 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4d719199-6748-46a2-997d-931aa352fb1e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:14.070693 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4d719199-6748-46a2-997d-931aa352fb1e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:14.071481 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4d719199-6748-46a2-997d-931aa352fb1e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:14.275502 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-6966ef36-c062-445f-8431-251943a7b4dd req-7ec6376f-a538-4f84-b45f-fdbd80decf60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72608569-4d23-4997-b09f-a8a50c5ba239", "tag": "f95e3858-0316-45ba-bcbb-2f08067c76ff"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:59:14.325924 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-6966ef36-c062-445f-8431-251943a7b4dd req-7ec6376f-a538-4f84-b45f-fdbd80decf60 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:14.586858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-6966ef36-c062-445f-8431-251943a7b4dd req-7ec6376f-a538-4f84-b45f-fdbd80decf60 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:14.586858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-6966ef36-c062-445f-8431-251943a7b4dd req-7ec6376f-a538-4f84-b45f-fdbd80decf60 service nova] Creating event network-changed:f95e3858-0316-45ba-bcbb-2f08067c76ff for instance 72608569-4d23-4997-b09f-a8a50c5ba239 on hv-cinder-81045 Jun 22 16:59:14.586858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-6966ef36-c062-445f-8431-251943a7b4dd req-7ec6376f-a538-4f84-b45f-fdbd80decf60 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 16:59:14.586858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f68bfac-0296-41e3-805f-61ea4ea62def None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:14.586858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f68bfac-0296-41e3-805f-61ea4ea62def None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:14.588263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f68bfac-0296-41e3-805f-61ea4ea62def None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:14.588263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f68bfac-0296-41e3-805f-61ea4ea62def None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:14.588263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.compute.rpcapi [None req-9f68bfac-0296-41e3-805f-61ea4ea62def None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 16:59:14.588263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f68bfac-0296-41e3-805f-61ea4ea62def None None] Releasing lock "compute-rpcapi-router" {{(pid=118472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 16:59:14.588263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9f68bfac-0296-41e3-805f-61ea4ea62def None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317498 Jun 22 16:59:14.588263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 16/41] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 16:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 16:59:14.589529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4d719199-6748-46a2-997d-931aa352fb1e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:14.589529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4d719199-6748-46a2-997d-931aa352fb1e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.536727 Jun 22 16:59:14.589529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 26/42] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:14 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:14.613435 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3183d3e2-01f0-4e0e-a581-30c6874e79b1 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:14.614109 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3183d3e2-01f0-4e0e-a581-30c6874e79b1 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:14.683557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3183d3e2-01f0-4e0e-a581-30c6874e79b1 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:14.683557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3183d3e2-01f0-4e0e-a581-30c6874e79b1 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:14.683557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3183d3e2-01f0-4e0e-a581-30c6874e79b1 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:14.683557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3183d3e2-01f0-4e0e-a581-30c6874e79b1 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:14.889702 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3183d3e2-01f0-4e0e-a581-30c6874e79b1 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:14.905722 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3183d3e2-01f0-4e0e-a581-30c6874e79b1 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.298512 Jun 22 16:59:14.909808 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 17/43] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:14 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:15.533866 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-1be371d1-ae2c-4b5e-b796-ef2faafe915a req-1797d674-8f19-456c-8cd6-3e801c77ab6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5342467a-6006-4ac5-91fd-573353d74fb6", "tag": "4a282a08-7e3f-42dd-80d9-fde38e300a52"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:59:15.561906 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-1be371d1-ae2c-4b5e-b796-ef2faafe915a req-1797d674-8f19-456c-8cd6-3e801c77ab6f service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:15.562347 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-1be371d1-ae2c-4b5e-b796-ef2faafe915a req-1797d674-8f19-456c-8cd6-3e801c77ab6f service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:15.577689 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8f9db8bb-54d2-4483-a344-ba4835d7d099 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:15.581370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8f9db8bb-54d2-4483-a344-ba4835d7d099 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:15.589225 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8f9db8bb-54d2-4483-a344-ba4835d7d099 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:15.590401 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8f9db8bb-54d2-4483-a344-ba4835d7d099 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:15.591355 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8f9db8bb-54d2-4483-a344-ba4835d7d099 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:15.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8f9db8bb-54d2-4483-a344-ba4835d7d099 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:15.641386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-1be371d1-ae2c-4b5e-b796-ef2faafe915a req-1797d674-8f19-456c-8cd6-3e801c77ab6f service nova] Creating event network-changed:4a282a08-7e3f-42dd-80d9-fde38e300a52 for instance 5342467a-6006-4ac5-91fd-573353d74fb6 on hv-cinder-81045 Jun 22 16:59:15.641990 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-1be371d1-ae2c-4b5e-b796-ef2faafe915a req-1797d674-8f19-456c-8cd6-3e801c77ab6f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118471) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 16:59:15.643546 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60594795-3d71-48fd-99ed-960d4be052d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:15.644550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60594795-3d71-48fd-99ed-960d4be052d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:15.645368 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60594795-3d71-48fd-99ed-960d4be052d2 None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:15.645949 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60594795-3d71-48fd-99ed-960d4be052d2 None None] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:15.660080 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.compute.rpcapi [None req-60594795-3d71-48fd-99ed-960d4be052d2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 16:59:15.664303 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60594795-3d71-48fd-99ed-960d4be052d2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118471) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 16:59:15.679694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-60594795-3d71-48fd-99ed-960d4be052d2 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266255 Jun 22 16:59:15.680564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 27/44] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 16:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:59:15.849064 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8f9db8bb-54d2-4483-a344-ba4835d7d099 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:15.856763 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8f9db8bb-54d2-4483-a344-ba4835d7d099 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.282734 Jun 22 16:59:15.857323 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 18/45] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:15 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:15.940192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f9b79251-7382-4e5f-9da0-6249b54532a8 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:15.940532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f9b79251-7382-4e5f-9da0-6249b54532a8 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:15.968997 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f9b79251-7382-4e5f-9da0-6249b54532a8 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:15.969727 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f9b79251-7382-4e5f-9da0-6249b54532a8 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:15.971130 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f9b79251-7382-4e5f-9da0-6249b54532a8 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:15.971993 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f9b79251-7382-4e5f-9da0-6249b54532a8 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:16.166889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f9b79251-7382-4e5f-9da0-6249b54532a8 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:16.180416 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f9b79251-7382-4e5f-9da0-6249b54532a8 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.249958 Jun 22 16:59:16.181342 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 28/46] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:15 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:16.874110 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2396a390-ce98-4da5-a7d3-d923d8a65aac tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:16.875595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2396a390-ce98-4da5-a7d3-d923d8a65aac tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:16.882822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2396a390-ce98-4da5-a7d3-d923d8a65aac tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:16.883523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2396a390-ce98-4da5-a7d3-d923d8a65aac tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:16.884563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2396a390-ce98-4da5-a7d3-d923d8a65aac tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:16.885347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2396a390-ce98-4da5-a7d3-d923d8a65aac tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:17.157095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2396a390-ce98-4da5-a7d3-d923d8a65aac tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:17.165709 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2396a390-ce98-4da5-a7d3-d923d8a65aac tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.295802 Jun 22 16:59:17.167016 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 19/47] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:16 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:17.196342 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6b8af5a7-d3ac-4622-8633-1eb10c506498 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:17.197172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6b8af5a7-d3ac-4622-8633-1eb10c506498 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:17.203826 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6b8af5a7-d3ac-4622-8633-1eb10c506498 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:17.204342 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6b8af5a7-d3ac-4622-8633-1eb10c506498 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:17.205121 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6b8af5a7-d3ac-4622-8633-1eb10c506498 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:17.205654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6b8af5a7-d3ac-4622-8633-1eb10c506498 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:17.449507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6b8af5a7-d3ac-4622-8633-1eb10c506498 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:17.460013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6b8af5a7-d3ac-4622-8633-1eb10c506498 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.266297 Jun 22 16:59:17.465503 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 29/48] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:17 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:17.710673 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-bd20c8db-de5b-4e2f-9684-d4389b3972bc req-b2e585b2-1e7d-48e3-95de-fd812bea0dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18dde809-575a-4930-b8f5-c7e39aee3f0b", "tag": "de9e5802-9729-4b30-b197-c80475f34f49"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:59:17.732978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-bd20c8db-de5b-4e2f-9684-d4389b3972bc req-b2e585b2-1e7d-48e3-95de-fd812bea0dcb service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:17.733858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-bd20c8db-de5b-4e2f-9684-d4389b3972bc req-b2e585b2-1e7d-48e3-95de-fd812bea0dcb service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:17.746576 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-bd20c8db-de5b-4e2f-9684-d4389b3972bc req-b2e585b2-1e7d-48e3-95de-fd812bea0dcb service nova] Creating event network-changed:de9e5802-9729-4b30-b197-c80475f34f49 for instance 18dde809-575a-4930-b8f5-c7e39aee3f0b on hv-cinder-81045 Jun 22 16:59:17.758900 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-bd20c8db-de5b-4e2f-9684-d4389b3972bc req-b2e585b2-1e7d-48e3-95de-fd812bea0dcb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053860 Jun 22 16:59:17.760697 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 20/49] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 16:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:59:18.194000 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2c9843c8-32f9-43dc-bb4d-af6199357cda tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:18.199290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2c9843c8-32f9-43dc-bb4d-af6199357cda tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:18.210958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c9843c8-32f9-43dc-bb4d-af6199357cda tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:18.211982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c9843c8-32f9-43dc-bb4d-af6199357cda tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:18.224978 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c9843c8-32f9-43dc-bb4d-af6199357cda tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:18.225540 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c9843c8-32f9-43dc-bb4d-af6199357cda tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:18.463781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2c9843c8-32f9-43dc-bb4d-af6199357cda tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:18.465567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2c9843c8-32f9-43dc-bb4d-af6199357cda tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.286448 Jun 22 16:59:18.466270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 30/50] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:18 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:18.479475 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b8c54da9-b5c6-47e0-b6d7-5dc34b929298 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:18.480195 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b8c54da9-b5c6-47e0-b6d7-5dc34b929298 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:18.486188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b8c54da9-b5c6-47e0-b6d7-5dc34b929298 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:18.486633 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b8c54da9-b5c6-47e0-b6d7-5dc34b929298 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:18.487387 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b8c54da9-b5c6-47e0-b6d7-5dc34b929298 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:18.487816 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b8c54da9-b5c6-47e0-b6d7-5dc34b929298 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:18.648410 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b8c54da9-b5c6-47e0-b6d7-5dc34b929298 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:18.659425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b8c54da9-b5c6-47e0-b6d7-5dc34b929298 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.181881 Jun 22 16:59:18.659425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 21/51] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:18 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:19.482206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-72a815be-242d-450d-87ae-9cb912e7f0a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:19.482810 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-72a815be-242d-450d-87ae-9cb912e7f0a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:19.492095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-72a815be-242d-450d-87ae-9cb912e7f0a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:19.492095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-72a815be-242d-450d-87ae-9cb912e7f0a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:19.492095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-72a815be-242d-450d-87ae-9cb912e7f0a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:19.492095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-72a815be-242d-450d-87ae-9cb912e7f0a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:19.666539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-72a815be-242d-450d-87ae-9cb912e7f0a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:19.674889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-72a815be-242d-450d-87ae-9cb912e7f0a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.196382 Jun 22 16:59:19.681227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e21218fe-a71d-4144-8dba-67bbdcbb04a0 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:19.682052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 31/52] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:19 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:19.682140 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e21218fe-a71d-4144-8dba-67bbdcbb04a0 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:19.689399 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e21218fe-a71d-4144-8dba-67bbdcbb04a0 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:19.689916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e21218fe-a71d-4144-8dba-67bbdcbb04a0 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:19.690752 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e21218fe-a71d-4144-8dba-67bbdcbb04a0 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:19.691248 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e21218fe-a71d-4144-8dba-67bbdcbb04a0 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:19.963117 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e21218fe-a71d-4144-8dba-67bbdcbb04a0 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:19.970968 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e21218fe-a71d-4144-8dba-67bbdcbb04a0 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.300032 Jun 22 16:59:19.971646 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 22/53] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:19 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:20.697876 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d66411c4-1139-4e2b-a3cf-bec88f662461 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:20.699361 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d66411c4-1139-4e2b-a3cf-bec88f662461 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:20.707022 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d66411c4-1139-4e2b-a3cf-bec88f662461 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:20.724301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d66411c4-1139-4e2b-a3cf-bec88f662461 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:20.724301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d66411c4-1139-4e2b-a3cf-bec88f662461 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:20.724301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d66411c4-1139-4e2b-a3cf-bec88f662461 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:20.893626 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d66411c4-1139-4e2b-a3cf-bec88f662461 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:20.902555 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d66411c4-1139-4e2b-a3cf-bec88f662461 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.210133 Jun 22 16:59:20.903208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 32/54] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:20 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:20.992401 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3bf6b9ba-3cc4-4c47-bce9-4fbda89f4871 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:20.992401 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3bf6b9ba-3cc4-4c47-bce9-4fbda89f4871 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:21.001858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bf6b9ba-3cc4-4c47-bce9-4fbda89f4871 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:21.003723 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bf6b9ba-3cc4-4c47-bce9-4fbda89f4871 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:21.005268 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bf6b9ba-3cc4-4c47-bce9-4fbda89f4871 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:21.007917 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bf6b9ba-3cc4-4c47-bce9-4fbda89f4871 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:21.341946 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3bf6b9ba-3cc4-4c47-bce9-4fbda89f4871 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:21.349585 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3bf6b9ba-3cc4-4c47-bce9-4fbda89f4871 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.364742 Jun 22 16:59:21.354318 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 23/55] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:20 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:21.922067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1bb30cdc-881e-4f88-95d4-f6e58fb0089d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:21.922736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1bb30cdc-881e-4f88-95d4-f6e58fb0089d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:21.943152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1bb30cdc-881e-4f88-95d4-f6e58fb0089d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:21.943152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1bb30cdc-881e-4f88-95d4-f6e58fb0089d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:21.943152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1bb30cdc-881e-4f88-95d4-f6e58fb0089d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:21.943152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1bb30cdc-881e-4f88-95d4-f6e58fb0089d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:22.203396 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1bb30cdc-881e-4f88-95d4-f6e58fb0089d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:22.213027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1bb30cdc-881e-4f88-95d4-f6e58fb0089d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.297359 Jun 22 16:59:22.223393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 33/56] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:21 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:22.378559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8282f937-dcce-4827-9de3-64f577b3a422 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:22.381360 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8282f937-dcce-4827-9de3-64f577b3a422 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:22.399155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8282f937-dcce-4827-9de3-64f577b3a422 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:22.405850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8282f937-dcce-4827-9de3-64f577b3a422 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:22.409512 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8282f937-dcce-4827-9de3-64f577b3a422 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:22.410141 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8282f937-dcce-4827-9de3-64f577b3a422 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:22.941007 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8282f937-dcce-4827-9de3-64f577b3a422 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:22.944672 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:22.948985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8282f937-dcce-4827-9de3-64f577b3a422 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.584214 Jun 22 16:59:22.950068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 24/57] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:22 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:23.231037 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e61495ed-b1f7-42c8-b376-67911b0560ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:23.231649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e61495ed-b1f7-42c8-b376-67911b0560ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:23.240889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e61495ed-b1f7-42c8-b376-67911b0560ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:23.240889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e61495ed-b1f7-42c8-b376-67911b0560ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:23.240889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e61495ed-b1f7-42c8-b376-67911b0560ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:23.240889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e61495ed-b1f7-42c8-b376-67911b0560ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:23.293688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:23.513300 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e61495ed-b1f7-42c8-b376-67911b0560ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:23.528703 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e61495ed-b1f7-42c8-b376-67911b0560ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.301457 Jun 22 16:59:23.540321 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 34/58] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:23 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:23.967131 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7d30577c-a639-4fba-a4e2-e806d2b8e043 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:23.967747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7d30577c-a639-4fba-a4e2-e806d2b8e043 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:24.036176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d30577c-a639-4fba-a4e2-e806d2b8e043 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:24.046266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d30577c-a639-4fba-a4e2-e806d2b8e043 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:24.047074 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d30577c-a639-4fba-a4e2-e806d2b8e043 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:24.047473 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d30577c-a639-4fba-a4e2-e806d2b8e043 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:24.387332 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:24.545611 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bd595318-1ae4-45b1-a33f-8a14a6f837cf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:24.546856 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bd595318-1ae4-45b1-a33f-8a14a6f837cf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:24.554386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd595318-1ae4-45b1-a33f-8a14a6f837cf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:24.556245 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd595318-1ae4-45b1-a33f-8a14a6f837cf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:24.557031 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd595318-1ae4-45b1-a33f-8a14a6f837cf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:24.557554 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd595318-1ae4-45b1-a33f-8a14a6f837cf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:24.566829 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7d30577c-a639-4fba-a4e2-e806d2b8e043 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:24.584352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7d30577c-a639-4fba-a4e2-e806d2b8e043 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.611961 Jun 22 16:59:24.584352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 25/59] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:23 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:24.997862 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bd595318-1ae4-45b1-a33f-8a14a6f837cf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:25.011210 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bd595318-1ae4-45b1-a33f-8a14a6f837cf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.469359 Jun 22 16:59:25.016254 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 35/60] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:24 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:25.598668 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1e4f6c55-11aa-4591-b69f-64db61a4a698 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:25.599414 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1e4f6c55-11aa-4591-b69f-64db61a4a698 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:25.609429 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e4f6c55-11aa-4591-b69f-64db61a4a698 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:25.610115 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e4f6c55-11aa-4591-b69f-64db61a4a698 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:25.611103 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e4f6c55-11aa-4591-b69f-64db61a4a698 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:25.611714 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e4f6c55-11aa-4591-b69f-64db61a4a698 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:25.843190 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1e4f6c55-11aa-4591-b69f-64db61a4a698 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:25.852019 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1e4f6c55-11aa-4591-b69f-64db61a4a698 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.262540 Jun 22 16:59:25.862783 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 26/61] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:25 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:26.030924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-156ba304-35f8-4a18-9398-438caf88bf6c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:26.032088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-156ba304-35f8-4a18-9398-438caf88bf6c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:26.035372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:26.038904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-156ba304-35f8-4a18-9398-438caf88bf6c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:26.039353 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-156ba304-35f8-4a18-9398-438caf88bf6c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:26.040140 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-156ba304-35f8-4a18-9398-438caf88bf6c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:26.040584 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-156ba304-35f8-4a18-9398-438caf88bf6c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:26.179767 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-156ba304-35f8-4a18-9398-438caf88bf6c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:26.187760 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-156ba304-35f8-4a18-9398-438caf88bf6c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.161187 Jun 22 16:59:26.188850 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 36/62] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:26 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:26.869636 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-677552a5-4756-4781-b56e-59fde1982280 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:26.870715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-677552a5-4756-4781-b56e-59fde1982280 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:26.891381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-677552a5-4756-4781-b56e-59fde1982280 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:26.893561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-677552a5-4756-4781-b56e-59fde1982280 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:26.893561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-677552a5-4756-4781-b56e-59fde1982280 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:26.893561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-677552a5-4756-4781-b56e-59fde1982280 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:27.125611 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-677552a5-4756-4781-b56e-59fde1982280 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:27.133962 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-677552a5-4756-4781-b56e-59fde1982280 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.268135 Jun 22 16:59:27.134523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 27/63] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:26 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:27.205151 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fca13602-1422-41c9-bd05-b7929eb2d24c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:27.205885 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fca13602-1422-41c9-bd05-b7929eb2d24c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:27.212856 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fca13602-1422-41c9-bd05-b7929eb2d24c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:27.213306 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fca13602-1422-41c9-bd05-b7929eb2d24c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:27.214065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fca13602-1422-41c9-bd05-b7929eb2d24c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:27.214499 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fca13602-1422-41c9-bd05-b7929eb2d24c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:27.353725 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fca13602-1422-41c9-bd05-b7929eb2d24c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:27.365358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fca13602-1422-41c9-bd05-b7929eb2d24c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.162712 Jun 22 16:59:27.383100 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 37/64] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:27 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:28.150889 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f7a25722-3a5a-4d85-9b6a-9cbdac3687ff tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:28.152404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f7a25722-3a5a-4d85-9b6a-9cbdac3687ff tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:28.159134 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f7a25722-3a5a-4d85-9b6a-9cbdac3687ff tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:28.165805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f7a25722-3a5a-4d85-9b6a-9cbdac3687ff tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:28.165805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f7a25722-3a5a-4d85-9b6a-9cbdac3687ff tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:28.165805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f7a25722-3a5a-4d85-9b6a-9cbdac3687ff tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:28.329684 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f7a25722-3a5a-4d85-9b6a-9cbdac3687ff tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:28.337606 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f7a25722-3a5a-4d85-9b6a-9cbdac3687ff tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.190649 Jun 22 16:59:28.352132 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 28/65] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:28 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:28.387020 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-04942f0d-0757-436d-b05b-ef1fd0342918 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:28.387455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-04942f0d-0757-436d-b05b-ef1fd0342918 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:28.389312 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:28.395204 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04942f0d-0757-436d-b05b-ef1fd0342918 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:28.395647 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04942f0d-0757-436d-b05b-ef1fd0342918 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:28.396434 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04942f0d-0757-436d-b05b-ef1fd0342918 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:28.396862 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04942f0d-0757-436d-b05b-ef1fd0342918 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:28.575007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-04942f0d-0757-436d-b05b-ef1fd0342918 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:28.582418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-04942f0d-0757-436d-b05b-ef1fd0342918 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.199466 Jun 22 16:59:28.587580 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 38/66] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:28 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:29.359368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-81961c91-18e7-46ad-861d-7f2154bffc1f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:29.359368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-81961c91-18e7-46ad-861d-7f2154bffc1f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:29.359368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:29.362479 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-81961c91-18e7-46ad-861d-7f2154bffc1f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:29.362912 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-81961c91-18e7-46ad-861d-7f2154bffc1f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:29.370506 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-81961c91-18e7-46ad-861d-7f2154bffc1f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:29.371679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-81961c91-18e7-46ad-861d-7f2154bffc1f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:29.517742 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-81961c91-18e7-46ad-861d-7f2154bffc1f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:29.526043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-81961c91-18e7-46ad-861d-7f2154bffc1f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.175129 Jun 22 16:59:29.537525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 29/67] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:29 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:29.600849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9fdcf554-472f-49ef-b4a3-4e3f0638518a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:29.601464 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9fdcf554-472f-49ef-b4a3-4e3f0638518a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:29.607880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9fdcf554-472f-49ef-b4a3-4e3f0638518a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:29.608374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9fdcf554-472f-49ef-b4a3-4e3f0638518a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:29.609135 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9fdcf554-472f-49ef-b4a3-4e3f0638518a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:29.609572 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9fdcf554-472f-49ef-b4a3-4e3f0638518a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:29.763568 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9fdcf554-472f-49ef-b4a3-4e3f0638518a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:29.773201 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9fdcf554-472f-49ef-b4a3-4e3f0638518a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.176321 Jun 22 16:59:29.773758 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 39/68] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:29 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:30.544625 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cc850a25-76d7-4c38-a8ef-190c26356b6a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:30.545373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cc850a25-76d7-4c38-a8ef-190c26356b6a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:30.554804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc850a25-76d7-4c38-a8ef-190c26356b6a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:30.554804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc850a25-76d7-4c38-a8ef-190c26356b6a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:30.554804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc850a25-76d7-4c38-a8ef-190c26356b6a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:30.554804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc850a25-76d7-4c38-a8ef-190c26356b6a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:30.730725 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cc850a25-76d7-4c38-a8ef-190c26356b6a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:30.742836 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cc850a25-76d7-4c38-a8ef-190c26356b6a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.201486 Jun 22 16:59:30.746694 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 30/69] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:30 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:30.790858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7c110b4a-e436-4c57-8f64-33f0b94bb55b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:30.795008 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7c110b4a-e436-4c57-8f64-33f0b94bb55b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:30.798470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c110b4a-e436-4c57-8f64-33f0b94bb55b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:30.800811 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c110b4a-e436-4c57-8f64-33f0b94bb55b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:30.804169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c110b4a-e436-4c57-8f64-33f0b94bb55b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:30.804169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c110b4a-e436-4c57-8f64-33f0b94bb55b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:31.035414 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7c110b4a-e436-4c57-8f64-33f0b94bb55b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:31.045064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7c110b4a-e436-4c57-8f64-33f0b94bb55b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.258412 Jun 22 16:59:31.047501 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 40/70] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:30 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:31.760379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b57b96fb-3e33-436d-aa77-f7dbcfd121e4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:31.760985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b57b96fb-3e33-436d-aa77-f7dbcfd121e4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:31.767533 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b57b96fb-3e33-436d-aa77-f7dbcfd121e4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:31.767975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b57b96fb-3e33-436d-aa77-f7dbcfd121e4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:31.768752 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b57b96fb-3e33-436d-aa77-f7dbcfd121e4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:31.769177 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b57b96fb-3e33-436d-aa77-f7dbcfd121e4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:31.926316 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b57b96fb-3e33-436d-aa77-f7dbcfd121e4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:31.935094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b57b96fb-3e33-436d-aa77-f7dbcfd121e4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.179134 Jun 22 16:59:31.938791 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 31/71] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:31 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:32.064994 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-abfb0455-a2b1-435a-99cf-8e8f4aa26780 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:32.066729 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-abfb0455-a2b1-435a-99cf-8e8f4aa26780 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:32.076425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-abfb0455-a2b1-435a-99cf-8e8f4aa26780 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:32.077461 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-abfb0455-a2b1-435a-99cf-8e8f4aa26780 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:32.078450 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-abfb0455-a2b1-435a-99cf-8e8f4aa26780 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:32.079208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-abfb0455-a2b1-435a-99cf-8e8f4aa26780 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:32.261349 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-abfb0455-a2b1-435a-99cf-8e8f4aa26780 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:32.271438 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-abfb0455-a2b1-435a-99cf-8e8f4aa26780 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.210953 Jun 22 16:59:32.281968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 41/72] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:32 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:32.955543 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e2ba6d97-ff1b-4681-b2c0-eee786ac3d09 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:32.956168 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e2ba6d97-ff1b-4681-b2c0-eee786ac3d09 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:32.963101 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e2ba6d97-ff1b-4681-b2c0-eee786ac3d09 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:32.963550 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e2ba6d97-ff1b-4681-b2c0-eee786ac3d09 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:32.964342 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e2ba6d97-ff1b-4681-b2c0-eee786ac3d09 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:32.964765 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e2ba6d97-ff1b-4681-b2c0-eee786ac3d09 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:33.134505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e2ba6d97-ff1b-4681-b2c0-eee786ac3d09 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:33.142573 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e2ba6d97-ff1b-4681-b2c0-eee786ac3d09 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.190716 Jun 22 16:59:33.143323 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 32/73] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:32 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:33.289652 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5042ce79-ebd5-4cd5-b011-f5ba2ae32a22 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:33.290255 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5042ce79-ebd5-4cd5-b011-f5ba2ae32a22 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:33.296695 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5042ce79-ebd5-4cd5-b011-f5ba2ae32a22 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:33.297138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5042ce79-ebd5-4cd5-b011-f5ba2ae32a22 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:33.304171 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5042ce79-ebd5-4cd5-b011-f5ba2ae32a22 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:33.304691 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5042ce79-ebd5-4cd5-b011-f5ba2ae32a22 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:33.489535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5042ce79-ebd5-4cd5-b011-f5ba2ae32a22 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:33.498535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5042ce79-ebd5-4cd5-b011-f5ba2ae32a22 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.213682 Jun 22 16:59:33.501660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 42/74] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:33 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:34.159392 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0359ac17-751a-41d7-ad18-3822d212c47b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:34.160223 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0359ac17-751a-41d7-ad18-3822d212c47b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:34.166998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0359ac17-751a-41d7-ad18-3822d212c47b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:34.167443 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0359ac17-751a-41d7-ad18-3822d212c47b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:34.168249 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0359ac17-751a-41d7-ad18-3822d212c47b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:34.168640 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0359ac17-751a-41d7-ad18-3822d212c47b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:34.202729 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-7590b9be-118f-4a1d-aefb-380a98bd8610 req-fe0e1e65-44d8-47c5-8aa2-512c91ff2fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5342467a-6006-4ac5-91fd-573353d74fb6", "name": "network-vif-plugged", "status": "completed", "tag": "4a282a08-7e3f-42dd-80d9-fde38e300a52"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:59:34.211420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7590b9be-118f-4a1d-aefb-380a98bd8610 req-fe0e1e65-44d8-47c5-8aa2-512c91ff2fd9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:34.211975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7590b9be-118f-4a1d-aefb-380a98bd8610 req-fe0e1e65-44d8-47c5-8aa2-512c91ff2fd9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:34.223277 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-7590b9be-118f-4a1d-aefb-380a98bd8610 req-fe0e1e65-44d8-47c5-8aa2-512c91ff2fd9 service nova] Creating event network-vif-plugged:4a282a08-7e3f-42dd-80d9-fde38e300a52 for instance 5342467a-6006-4ac5-91fd-573353d74fb6 on hv-cinder-81045 Jun 22 16:59:34.228587 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-7590b9be-118f-4a1d-aefb-380a98bd8610 req-fe0e1e65-44d8-47c5-8aa2-512c91ff2fd9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086663 Jun 22 16:59:34.230333 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 33/75] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 16:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:59:34.302959 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0359ac17-751a-41d7-ad18-3822d212c47b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:34.310861 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0359ac17-751a-41d7-ad18-3822d212c47b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.155383 Jun 22 16:59:34.311607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 43/76] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:34 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:34.517066 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-53623d9a-604a-4473-a5bb-ead564441205 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:34.517762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-53623d9a-604a-4473-a5bb-ead564441205 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:34.524360 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-53623d9a-604a-4473-a5bb-ead564441205 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:34.524808 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-53623d9a-604a-4473-a5bb-ead564441205 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:34.525581 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-53623d9a-604a-4473-a5bb-ead564441205 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:34.526011 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-53623d9a-604a-4473-a5bb-ead564441205 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:34.670674 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-53623d9a-604a-4473-a5bb-ead564441205 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:34.679022 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-53623d9a-604a-4473-a5bb-ead564441205 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.165386 Jun 22 16:59:34.679671 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 34/77] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:34 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:35.328093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-34ab3aff-1284-49df-8da8-da354bc463fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:35.328739 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-34ab3aff-1284-49df-8da8-da354bc463fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:35.335778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34ab3aff-1284-49df-8da8-da354bc463fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:35.336261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34ab3aff-1284-49df-8da8-da354bc463fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:35.355175 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34ab3aff-1284-49df-8da8-da354bc463fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:35.355175 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34ab3aff-1284-49df-8da8-da354bc463fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:35.474289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-34ab3aff-1284-49df-8da8-da354bc463fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:35.482540 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-34ab3aff-1284-49df-8da8-da354bc463fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.158254 Jun 22 16:59:35.483103 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 44/78] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:35 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:35.697445 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c063febf-65b3-41fb-a99a-0c2c1ff308db tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:35.699205 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c063febf-65b3-41fb-a99a-0c2c1ff308db tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:35.708682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c063febf-65b3-41fb-a99a-0c2c1ff308db tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:35.709373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c063febf-65b3-41fb-a99a-0c2c1ff308db tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:35.710337 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c063febf-65b3-41fb-a99a-0c2c1ff308db tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:35.711083 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c063febf-65b3-41fb-a99a-0c2c1ff308db tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:35.852460 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c063febf-65b3-41fb-a99a-0c2c1ff308db tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:35.866337 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c063febf-65b3-41fb-a99a-0c2c1ff308db tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.168302 Jun 22 16:59:35.866337 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 35/79] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:35 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:36.247332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-513bce96-1351-4ca4-967c-7a3d78ad75d9 req-6f8ebe3e-3365-4c8f-a545-02507dc23ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72608569-4d23-4997-b09f-a8a50c5ba239", "name": "network-vif-plugged", "status": "completed", "tag": "f95e3858-0316-45ba-bcbb-2f08067c76ff"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:59:36.256417 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-513bce96-1351-4ca4-967c-7a3d78ad75d9 req-6f8ebe3e-3365-4c8f-a545-02507dc23ec4 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:36.256866 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-513bce96-1351-4ca4-967c-7a3d78ad75d9 req-6f8ebe3e-3365-4c8f-a545-02507dc23ec4 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:36.268292 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-513bce96-1351-4ca4-967c-7a3d78ad75d9 req-6f8ebe3e-3365-4c8f-a545-02507dc23ec4 service nova] Creating event network-vif-plugged:f95e3858-0316-45ba-bcbb-2f08067c76ff for instance 72608569-4d23-4997-b09f-a8a50c5ba239 on hv-cinder-81045 Jun 22 16:59:36.273344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-513bce96-1351-4ca4-967c-7a3d78ad75d9 req-6f8ebe3e-3365-4c8f-a545-02507dc23ec4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030022 Jun 22 16:59:36.273993 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 45/80] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 16:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:59:36.499661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5953cb81-3bac-41bb-b263-d826b0db8080 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:36.500466 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5953cb81-3bac-41bb-b263-d826b0db8080 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:36.517014 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5953cb81-3bac-41bb-b263-d826b0db8080 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:36.517762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5953cb81-3bac-41bb-b263-d826b0db8080 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:36.518963 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5953cb81-3bac-41bb-b263-d826b0db8080 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:36.519605 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5953cb81-3bac-41bb-b263-d826b0db8080 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:36.878369 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-487b212b-b959-4f8e-8f9c-d77bbcdbe503 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:36.879065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-487b212b-b959-4f8e-8f9c-d77bbcdbe503 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:36.886061 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-487b212b-b959-4f8e-8f9c-d77bbcdbe503 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:36.886511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-487b212b-b959-4f8e-8f9c-d77bbcdbe503 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:36.887500 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-487b212b-b959-4f8e-8f9c-d77bbcdbe503 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:36.888129 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-487b212b-b959-4f8e-8f9c-d77bbcdbe503 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:36.916826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5953cb81-3bac-41bb-b263-d826b0db8080 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:36.930465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5953cb81-3bac-41bb-b263-d826b0db8080 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.434818 Jun 22 16:59:36.931036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 36/81] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:36 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:37.053845 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-487b212b-b959-4f8e-8f9c-d77bbcdbe503 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:37.061294 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-487b212b-b959-4f8e-8f9c-d77bbcdbe503 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.187592 Jun 22 16:59:37.061861 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 46/82] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:36 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:37.946725 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8a228e15-4f8a-4629-bfc4-b7aa1d55e2ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:37.947258 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8a228e15-4f8a-4629-bfc4-b7aa1d55e2ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:37.954499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a228e15-4f8a-4629-bfc4-b7aa1d55e2ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:37.954499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a228e15-4f8a-4629-bfc4-b7aa1d55e2ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:37.954664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a228e15-4f8a-4629-bfc4-b7aa1d55e2ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:37.955078 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a228e15-4f8a-4629-bfc4-b7aa1d55e2ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:38.078165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-48ebe18f-312c-4798-8a3d-70d5c10d4c4c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:38.078764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-48ebe18f-312c-4798-8a3d-70d5c10d4c4c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:38.085797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-48ebe18f-312c-4798-8a3d-70d5c10d4c4c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:38.089462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-48ebe18f-312c-4798-8a3d-70d5c10d4c4c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:38.089462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-48ebe18f-312c-4798-8a3d-70d5c10d4c4c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:38.089462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-48ebe18f-312c-4798-8a3d-70d5c10d4c4c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:38.100932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8a228e15-4f8a-4629-bfc4-b7aa1d55e2ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:38.108253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8a228e15-4f8a-4629-bfc4-b7aa1d55e2ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.165402 Jun 22 16:59:38.108810 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 37/83] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:37 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:38.224562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-48ebe18f-312c-4798-8a3d-70d5c10d4c4c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:38.232607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-48ebe18f-312c-4798-8a3d-70d5c10d4c4c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.158336 Jun 22 16:59:38.233209 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 47/84] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:38 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:39.125607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-554dc854-ce41-4268-938f-cd9e00d14f26 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:39.126059 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-554dc854-ce41-4268-938f-cd9e00d14f26 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:39.132448 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-554dc854-ce41-4268-938f-cd9e00d14f26 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:39.133198 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-554dc854-ce41-4268-938f-cd9e00d14f26 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:39.133999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-554dc854-ce41-4268-938f-cd9e00d14f26 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:39.134582 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-554dc854-ce41-4268-938f-cd9e00d14f26 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:39.248930 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-38d031b7-7373-4196-8bb2-ff4b736cdb16 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:39.249753 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-38d031b7-7373-4196-8bb2-ff4b736cdb16 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:39.257105 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-38d031b7-7373-4196-8bb2-ff4b736cdb16 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:39.257105 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-38d031b7-7373-4196-8bb2-ff4b736cdb16 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:39.257439 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-38d031b7-7373-4196-8bb2-ff4b736cdb16 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:39.257981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-38d031b7-7373-4196-8bb2-ff4b736cdb16 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:39.267060 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-554dc854-ce41-4268-938f-cd9e00d14f26 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:39.278051 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-554dc854-ce41-4268-938f-cd9e00d14f26 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.156203 Jun 22 16:59:39.288258 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 38/85] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:39 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:39.452781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-38d031b7-7373-4196-8bb2-ff4b736cdb16 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:39.461116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-38d031b7-7373-4196-8bb2-ff4b736cdb16 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.215946 Jun 22 16:59:39.468491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 48/86] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:39 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:40.295088 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-63e5039a-16fe-4c09-968f-4acc1f1c60df tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:40.295693 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-63e5039a-16fe-4c09-968f-4acc1f1c60df tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:40.301676 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-63e5039a-16fe-4c09-968f-4acc1f1c60df tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:40.302123 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-63e5039a-16fe-4c09-968f-4acc1f1c60df tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:40.302877 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-63e5039a-16fe-4c09-968f-4acc1f1c60df tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:40.304982 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-63e5039a-16fe-4c09-968f-4acc1f1c60df tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:40.442073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-63e5039a-16fe-4c09-968f-4acc1f1c60df tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:40.449871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-63e5039a-16fe-4c09-968f-4acc1f1c60df tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.158938 Jun 22 16:59:40.450431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 39/87] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:40 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:40.477812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b36d68d1-a15c-4eae-ac27-1dddc9cee932 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:40.478419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b36d68d1-a15c-4eae-ac27-1dddc9cee932 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:40.484358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b36d68d1-a15c-4eae-ac27-1dddc9cee932 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:40.484807 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b36d68d1-a15c-4eae-ac27-1dddc9cee932 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:40.485558 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b36d68d1-a15c-4eae-ac27-1dddc9cee932 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:40.485985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b36d68d1-a15c-4eae-ac27-1dddc9cee932 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:40.629423 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b36d68d1-a15c-4eae-ac27-1dddc9cee932 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:40.636846 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b36d68d1-a15c-4eae-ac27-1dddc9cee932 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.162956 Jun 22 16:59:40.637412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 49/88] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:40 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:41.467104 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5ca396ae-37f8-405c-8fbe-a1795ea6a789 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:41.467742 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5ca396ae-37f8-405c-8fbe-a1795ea6a789 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:41.473827 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5ca396ae-37f8-405c-8fbe-a1795ea6a789 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:41.474271 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5ca396ae-37f8-405c-8fbe-a1795ea6a789 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:41.475026 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5ca396ae-37f8-405c-8fbe-a1795ea6a789 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:41.475639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5ca396ae-37f8-405c-8fbe-a1795ea6a789 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:41.606468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5ca396ae-37f8-405c-8fbe-a1795ea6a789 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:41.614234 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5ca396ae-37f8-405c-8fbe-a1795ea6a789 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.150834 Jun 22 16:59:41.614838 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 40/89] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:41 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:41.654668 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f28db078-8076-4763-b36b-0264739c2013 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:41.655431 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f28db078-8076-4763-b36b-0264739c2013 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:41.663253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f28db078-8076-4763-b36b-0264739c2013 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:41.667101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f28db078-8076-4763-b36b-0264739c2013 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:41.667101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f28db078-8076-4763-b36b-0264739c2013 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:41.667101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f28db078-8076-4763-b36b-0264739c2013 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:41.797177 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f28db078-8076-4763-b36b-0264739c2013 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:41.805344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f28db078-8076-4763-b36b-0264739c2013 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.155292 Jun 22 16:59:41.806239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 50/90] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:41 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:42.630608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ede16c22-1262-474d-a48a-72707c40156b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:42.631297 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ede16c22-1262-474d-a48a-72707c40156b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:42.637294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ede16c22-1262-474d-a48a-72707c40156b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:42.637738 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ede16c22-1262-474d-a48a-72707c40156b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:42.638498 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ede16c22-1262-474d-a48a-72707c40156b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:42.638931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ede16c22-1262-474d-a48a-72707c40156b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:42.778830 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ede16c22-1262-474d-a48a-72707c40156b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:42.787052 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ede16c22-1262-474d-a48a-72707c40156b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.160272 Jun 22 16:59:42.787613 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 41/91] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:42 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:42.822490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b836db58-a49b-48d5-b0ab-89e214fb2aed tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:42.823104 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b836db58-a49b-48d5-b0ab-89e214fb2aed tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:42.829051 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b836db58-a49b-48d5-b0ab-89e214fb2aed tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:42.829525 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b836db58-a49b-48d5-b0ab-89e214fb2aed tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:42.830285 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b836db58-a49b-48d5-b0ab-89e214fb2aed tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:42.830718 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b836db58-a49b-48d5-b0ab-89e214fb2aed tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:42.967068 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b836db58-a49b-48d5-b0ab-89e214fb2aed tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:42.970782 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:42.975511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b836db58-a49b-48d5-b0ab-89e214fb2aed tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.157382 Jun 22 16:59:42.976161 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 51/92] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:42 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:43.805145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2e0724ed-f98b-4c9e-82b7-194fb0351389 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:43.805870 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2e0724ed-f98b-4c9e-82b7-194fb0351389 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:43.812043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e0724ed-f98b-4c9e-82b7-194fb0351389 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:43.812695 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e0724ed-f98b-4c9e-82b7-194fb0351389 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:43.813604 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e0724ed-f98b-4c9e-82b7-194fb0351389 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:43.814031 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e0724ed-f98b-4c9e-82b7-194fb0351389 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:43.818262 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.958867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2e0724ed-f98b-4c9e-82b7-194fb0351389 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:43.967281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2e0724ed-f98b-4c9e-82b7-194fb0351389 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.166449 Jun 22 16:59:43.967842 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 42/93] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:43 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:43.992412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ee272836-7385-4ac5-adc3-764f8ed1f349 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:43.993029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ee272836-7385-4ac5-adc3-764f8ed1f349 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:44.003770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee272836-7385-4ac5-adc3-764f8ed1f349 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:44.003770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee272836-7385-4ac5-adc3-764f8ed1f349 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:44.003770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee272836-7385-4ac5-adc3-764f8ed1f349 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:44.003770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee272836-7385-4ac5-adc3-764f8ed1f349 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:44.140281 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ee272836-7385-4ac5-adc3-764f8ed1f349 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:44.148254 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ee272836-7385-4ac5-adc3-764f8ed1f349 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.159143 Jun 22 16:59:44.148809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 52/94] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:43 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:44.984306 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b7c64c57-bce9-4e2e-aaf6-19cd0fe1c7fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:44.984934 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b7c64c57-bce9-4e2e-aaf6-19cd0fe1c7fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:44.991283 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b7c64c57-bce9-4e2e-aaf6-19cd0fe1c7fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:44.991545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b7c64c57-bce9-4e2e-aaf6-19cd0fe1c7fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:44.992355 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b7c64c57-bce9-4e2e-aaf6-19cd0fe1c7fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:44.992785 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b7c64c57-bce9-4e2e-aaf6-19cd0fe1c7fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:45.150189 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b7c64c57-bce9-4e2e-aaf6-19cd0fe1c7fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:45.159145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b7c64c57-bce9-4e2e-aaf6-19cd0fe1c7fa tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.179004 Jun 22 16:59:45.159698 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 43/95] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:44 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:45.165262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3d76fe2e-52eb-427e-a29d-f78d1bb6fac8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:45.166671 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3d76fe2e-52eb-427e-a29d-f78d1bb6fac8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:45.172953 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3d76fe2e-52eb-427e-a29d-f78d1bb6fac8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:45.173485 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3d76fe2e-52eb-427e-a29d-f78d1bb6fac8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:45.174332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3d76fe2e-52eb-427e-a29d-f78d1bb6fac8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:45.177808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3d76fe2e-52eb-427e-a29d-f78d1bb6fac8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:45.312314 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3d76fe2e-52eb-427e-a29d-f78d1bb6fac8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:45.321550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3d76fe2e-52eb-427e-a29d-f78d1bb6fac8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.160265 Jun 22 16:59:45.322410 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 53/96] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:45 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:46.176004 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d2b3e48f-1971-4b9f-a1c1-b7534886643a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:46.176652 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d2b3e48f-1971-4b9f-a1c1-b7534886643a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:46.183368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2b3e48f-1971-4b9f-a1c1-b7534886643a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:46.183819 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2b3e48f-1971-4b9f-a1c1-b7534886643a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:46.184775 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2b3e48f-1971-4b9f-a1c1-b7534886643a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:46.185347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2b3e48f-1971-4b9f-a1c1-b7534886643a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:46.339713 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0149c3c6-d71e-4d5d-a17f-00247259da2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:46.340351 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0149c3c6-d71e-4d5d-a17f-00247259da2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:46.346997 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0149c3c6-d71e-4d5d-a17f-00247259da2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:46.347523 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0149c3c6-d71e-4d5d-a17f-00247259da2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:46.348461 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0149c3c6-d71e-4d5d-a17f-00247259da2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:46.349204 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0149c3c6-d71e-4d5d-a17f-00247259da2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:46.359915 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d2b3e48f-1971-4b9f-a1c1-b7534886643a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:46.369336 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d2b3e48f-1971-4b9f-a1c1-b7534886643a tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.197069 Jun 22 16:59:46.382295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 44/97] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:46 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:46.505491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0149c3c6-d71e-4d5d-a17f-00247259da2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:46.512848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0149c3c6-d71e-4d5d-a17f-00247259da2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.177811 Jun 22 16:59:46.513411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 54/98] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:46 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:47.391587 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9dc03982-cf18-423f-b84f-46a07cf71149 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:47.393072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9dc03982-cf18-423f-b84f-46a07cf71149 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:47.399276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9dc03982-cf18-423f-b84f-46a07cf71149 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:47.399950 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9dc03982-cf18-423f-b84f-46a07cf71149 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:47.400983 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9dc03982-cf18-423f-b84f-46a07cf71149 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:47.401819 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9dc03982-cf18-423f-b84f-46a07cf71149 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:47.536536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ba3ed2ec-4c6b-4784-9097-e7bc77ef4fee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:47.536536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ba3ed2ec-4c6b-4784-9097-e7bc77ef4fee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:47.536536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ba3ed2ec-4c6b-4784-9097-e7bc77ef4fee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:47.537094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ba3ed2ec-4c6b-4784-9097-e7bc77ef4fee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:47.537706 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ba3ed2ec-4c6b-4784-9097-e7bc77ef4fee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:47.538706 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ba3ed2ec-4c6b-4784-9097-e7bc77ef4fee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:47.542620 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9dc03982-cf18-423f-b84f-46a07cf71149 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:47.550667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9dc03982-cf18-423f-b84f-46a07cf71149 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.164373 Jun 22 16:59:47.551338 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 45/99] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:47 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:47.672275 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ba3ed2ec-4c6b-4784-9097-e7bc77ef4fee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:47.680265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ba3ed2ec-4c6b-4784-9097-e7bc77ef4fee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.154506 Jun 22 16:59:47.680829 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 55/100] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:47 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:48.571853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e342ea1a-2ed2-47ad-9c8b-86efad98c91d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:48.572424 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e342ea1a-2ed2-47ad-9c8b-86efad98c91d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:48.578328 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e342ea1a-2ed2-47ad-9c8b-86efad98c91d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:48.578773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e342ea1a-2ed2-47ad-9c8b-86efad98c91d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:48.579524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e342ea1a-2ed2-47ad-9c8b-86efad98c91d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:48.579952 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e342ea1a-2ed2-47ad-9c8b-86efad98c91d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:48.697381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6173f294-3f76-4b3f-b001-ede9d64f014e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:48.698142 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6173f294-3f76-4b3f-b001-ede9d64f014e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:48.704227 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6173f294-3f76-4b3f-b001-ede9d64f014e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:48.704738 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6173f294-3f76-4b3f-b001-ede9d64f014e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:48.705622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6173f294-3f76-4b3f-b001-ede9d64f014e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:48.706111 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6173f294-3f76-4b3f-b001-ede9d64f014e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:48.707905 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e342ea1a-2ed2-47ad-9c8b-86efad98c91d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:48.715235 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e342ea1a-2ed2-47ad-9c8b-86efad98c91d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.147788 Jun 22 16:59:48.715800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 46/101] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:48 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:48.834825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6173f294-3f76-4b3f-b001-ede9d64f014e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:48.842142 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6173f294-3f76-4b3f-b001-ede9d64f014e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.149187 Jun 22 16:59:48.842699 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 56/102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:48 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:49.732221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9919f748-376f-4461-b94b-0461ad2ef2dd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:49.732765 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9919f748-376f-4461-b94b-0461ad2ef2dd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:49.738657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9919f748-376f-4461-b94b-0461ad2ef2dd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:49.739105 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9919f748-376f-4461-b94b-0461ad2ef2dd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:49.739857 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9919f748-376f-4461-b94b-0461ad2ef2dd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:49.740332 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9919f748-376f-4461-b94b-0461ad2ef2dd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:49.859106 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b8407003-cc2f-420f-bf36-90e49f1beb2e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:49.859718 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b8407003-cc2f-420f-bf36-90e49f1beb2e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:49.864922 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9919f748-376f-4461-b94b-0461ad2ef2dd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:49.866193 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8407003-cc2f-420f-bf36-90e49f1beb2e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:49.867199 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8407003-cc2f-420f-bf36-90e49f1beb2e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:49.868178 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8407003-cc2f-420f-bf36-90e49f1beb2e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:49.868615 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8407003-cc2f-420f-bf36-90e49f1beb2e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:49.873743 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9919f748-376f-4461-b94b-0461ad2ef2dd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.145319 Jun 22 16:59:49.876158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 47/103] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:49 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:49.996700 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b8407003-cc2f-420f-bf36-90e49f1beb2e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:50.010801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b8407003-cc2f-420f-bf36-90e49f1beb2e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.149488 Jun 22 16:59:50.010801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 57/104] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:49 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:50.084129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-1581f4f6-0315-403e-b98e-d1fa3d455bc6 req-a77ae8ae-d303-4fbc-8db9-b7bcae4ad106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dde809-575a-4930-b8f5-c7e39aee3f0b", "name": "network-vif-plugged", "status": "completed", "tag": "de9e5802-9729-4b30-b197-c80475f34f49"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 16:59:50.092568 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1581f4f6-0315-403e-b98e-d1fa3d455bc6 req-a77ae8ae-d303-4fbc-8db9-b7bcae4ad106 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:50.093005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1581f4f6-0315-403e-b98e-d1fa3d455bc6 req-a77ae8ae-d303-4fbc-8db9-b7bcae4ad106 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:50.104309 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-1581f4f6-0315-403e-b98e-d1fa3d455bc6 req-a77ae8ae-d303-4fbc-8db9-b7bcae4ad106 service nova] Creating event network-vif-plugged:de9e5802-9729-4b30-b197-c80475f34f49 for instance 18dde809-575a-4930-b8f5-c7e39aee3f0b on hv-cinder-81045 Jun 22 16:59:50.109270 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-1581f4f6-0315-403e-b98e-d1fa3d455bc6 req-a77ae8ae-d303-4fbc-8db9-b7bcae4ad106 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028823 Jun 22 16:59:50.109848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 48/105] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 16:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 16:59:50.891483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-82d00046-bafc-435e-a360-171933e8c495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:50.892024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-82d00046-bafc-435e-a360-171933e8c495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:50.897970 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-82d00046-bafc-435e-a360-171933e8c495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:50.898411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-82d00046-bafc-435e-a360-171933e8c495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:50.899160 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-82d00046-bafc-435e-a360-171933e8c495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:50.899587 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-82d00046-bafc-435e-a360-171933e8c495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:51.027310 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c909e308-9808-4ee9-aeb7-6df6654a6854 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:51.028013 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c909e308-9808-4ee9-aeb7-6df6654a6854 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:51.028516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-82d00046-bafc-435e-a360-171933e8c495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:51.034319 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c909e308-9808-4ee9-aeb7-6df6654a6854 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:51.034764 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c909e308-9808-4ee9-aeb7-6df6654a6854 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:51.035525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c909e308-9808-4ee9-aeb7-6df6654a6854 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:51.035950 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-82d00046-bafc-435e-a360-171933e8c495 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.148412 Jun 22 16:59:51.036044 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c909e308-9808-4ee9-aeb7-6df6654a6854 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:51.038649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 58/106] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:50 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:51.164180 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c909e308-9808-4ee9-aeb7-6df6654a6854 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:51.171467 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c909e308-9808-4ee9-aeb7-6df6654a6854 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.154552 Jun 22 16:59:51.172020 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 49/107] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:51 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:52.053229 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b8f4570c-ea02-4380-a269-41a40b8c8e6d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:52.054405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b8f4570c-ea02-4380-a269-41a40b8c8e6d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:52.060370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8f4570c-ea02-4380-a269-41a40b8c8e6d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:52.060814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8f4570c-ea02-4380-a269-41a40b8c8e6d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:52.061583 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8f4570c-ea02-4380-a269-41a40b8c8e6d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:52.061996 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8f4570c-ea02-4380-a269-41a40b8c8e6d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:52.185586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b8f4570c-ea02-4380-a269-41a40b8c8e6d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:52.188548 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1b6331e6-6b60-49ab-af66-a4e3d561a176 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:52.189245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1b6331e6-6b60-49ab-af66-a4e3d561a176 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:52.193090 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b8f4570c-ea02-4380-a269-41a40b8c8e6d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.143618 Jun 22 16:59:52.193651 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 59/108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:52 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:52.195088 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b6331e6-6b60-49ab-af66-a4e3d561a176 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:52.195526 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b6331e6-6b60-49ab-af66-a4e3d561a176 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:52.196310 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b6331e6-6b60-49ab-af66-a4e3d561a176 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:52.196918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b6331e6-6b60-49ab-af66-a4e3d561a176 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:52.328150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1b6331e6-6b60-49ab-af66-a4e3d561a176 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:52.335350 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1b6331e6-6b60-49ab-af66-a4e3d561a176 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.150050 Jun 22 16:59:52.335941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 50/109] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:52 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:53.209591 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-62646d4e-1580-4603-9d93-485e292a263e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:53.210190 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-62646d4e-1580-4603-9d93-485e292a263e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:53.216063 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62646d4e-1580-4603-9d93-485e292a263e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:53.216535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62646d4e-1580-4603-9d93-485e292a263e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:53.217276 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62646d4e-1580-4603-9d93-485e292a263e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:53.217700 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62646d4e-1580-4603-9d93-485e292a263e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:53.347358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-62646d4e-1580-4603-9d93-485e292a263e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:53.351656 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cf66e3cb-0aed-4d8d-96e4-bfc01b633a1b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:53.352801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cf66e3cb-0aed-4d8d-96e4-bfc01b633a1b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:53.357009 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-62646d4e-1580-4603-9d93-485e292a263e tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.151109 Jun 22 16:59:53.365214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 60/110] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:53 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:53.365610 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf66e3cb-0aed-4d8d-96e4-bfc01b633a1b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:53.365610 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf66e3cb-0aed-4d8d-96e4-bfc01b633a1b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:53.365610 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf66e3cb-0aed-4d8d-96e4-bfc01b633a1b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:53.365610 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf66e3cb-0aed-4d8d-96e4-bfc01b633a1b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:53.490585 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cf66e3cb-0aed-4d8d-96e4-bfc01b633a1b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:53.498885 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cf66e3cb-0aed-4d8d-96e4-bfc01b633a1b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.150967 Jun 22 16:59:53.499436 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 51/111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:53 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:54.374261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-884145ae-6ffa-42be-ba62-baded8b7d008 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:54.374861 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-884145ae-6ffa-42be-ba62-baded8b7d008 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:54.381284 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-884145ae-6ffa-42be-ba62-baded8b7d008 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:54.381724 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-884145ae-6ffa-42be-ba62-baded8b7d008 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:54.382473 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-884145ae-6ffa-42be-ba62-baded8b7d008 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:54.382899 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-884145ae-6ffa-42be-ba62-baded8b7d008 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:54.515241 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-07964c91-ebe1-49ad-adcb-670617eced18 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:54.515843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-07964c91-ebe1-49ad-adcb-670617eced18 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:54.520317 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-884145ae-6ffa-42be-ba62-baded8b7d008 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:54.521704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07964c91-ebe1-49ad-adcb-670617eced18 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:54.522148 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07964c91-ebe1-49ad-adcb-670617eced18 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:54.522899 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07964c91-ebe1-49ad-adcb-670617eced18 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:54.523321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07964c91-ebe1-49ad-adcb-670617eced18 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:54.528197 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-884145ae-6ffa-42be-ba62-baded8b7d008 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.157626 Jun 22 16:59:54.528814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 61/112] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:54 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:54.652917 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-07964c91-ebe1-49ad-adcb-670617eced18 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:54.660052 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-07964c91-ebe1-49ad-adcb-670617eced18 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.148664 Jun 22 16:59:54.660648 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 52/113] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:54 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:55.545247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-12a3e571-3261-48d9-a355-551467fbdacd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:55.545858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-12a3e571-3261-48d9-a355-551467fbdacd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:55.551711 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-12a3e571-3261-48d9-a355-551467fbdacd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:55.552179 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-12a3e571-3261-48d9-a355-551467fbdacd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:55.552928 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-12a3e571-3261-48d9-a355-551467fbdacd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:55.553355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-12a3e571-3261-48d9-a355-551467fbdacd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:55.676619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3e4bb3c6-d7e3-4e9f-a672-3ee7fcdee019 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:55.677217 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3e4bb3c6-d7e3-4e9f-a672-3ee7fcdee019 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:55.679089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-12a3e571-3261-48d9-a355-551467fbdacd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:55.683876 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e4bb3c6-d7e3-4e9f-a672-3ee7fcdee019 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:55.684347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e4bb3c6-d7e3-4e9f-a672-3ee7fcdee019 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:55.685145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e4bb3c6-d7e3-4e9f-a672-3ee7fcdee019 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:55.685535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e4bb3c6-d7e3-4e9f-a672-3ee7fcdee019 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:55.687021 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-12a3e571-3261-48d9-a355-551467fbdacd tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.146103 Jun 22 16:59:55.687898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 62/114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:55 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:55.809541 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3e4bb3c6-d7e3-4e9f-a672-3ee7fcdee019 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:55.816758 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3e4bb3c6-d7e3-4e9f-a672-3ee7fcdee019 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.144006 Jun 22 16:59:55.817344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 53/115] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:55 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:56.704370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-de84a984-1845-4b3f-b8b2-f07241c667ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:56.704917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-de84a984-1845-4b3f-b8b2-f07241c667ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:56.710790 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-de84a984-1845-4b3f-b8b2-f07241c667ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:56.711259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-de84a984-1845-4b3f-b8b2-f07241c667ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:56.712002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-de84a984-1845-4b3f-b8b2-f07241c667ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:56.712449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-de84a984-1845-4b3f-b8b2-f07241c667ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:56.834459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a601a5b4-8502-4c7e-b6a3-5294a917f728 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:56.835305 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a601a5b4-8502-4c7e-b6a3-5294a917f728 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:56.842481 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a601a5b4-8502-4c7e-b6a3-5294a917f728 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:56.842923 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a601a5b4-8502-4c7e-b6a3-5294a917f728 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:56.843770 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a601a5b4-8502-4c7e-b6a3-5294a917f728 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:56.844226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a601a5b4-8502-4c7e-b6a3-5294a917f728 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:56.844646 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-de84a984-1845-4b3f-b8b2-f07241c667ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:56.852147 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-de84a984-1845-4b3f-b8b2-f07241c667ab tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1314 microversion: 2.1 time: 0.151587 Jun 22 16:59:56.865408 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 63/116] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:56 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:56.983165 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a601a5b4-8502-4c7e-b6a3-5294a917f728 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:56.990491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a601a5b4-8502-4c7e-b6a3-5294a917f728 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.159960 Jun 22 16:59:56.991049 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 54/117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:56 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:57.870355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-01012da8-9c5a-4eb7-98ea-7ebf1fa70c92 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:57.870958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-01012da8-9c5a-4eb7-98ea-7ebf1fa70c92 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:57.877183 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01012da8-9c5a-4eb7-98ea-7ebf1fa70c92 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:57.877624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01012da8-9c5a-4eb7-98ea-7ebf1fa70c92 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:57.878369 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01012da8-9c5a-4eb7-98ea-7ebf1fa70c92 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:57.878793 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01012da8-9c5a-4eb7-98ea-7ebf1fa70c92 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:58.007054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6086f68b-581f-46a1-8766-0cb34e8adcfa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:58.008498 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6086f68b-581f-46a1-8766-0cb34e8adcfa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:58.014871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6086f68b-581f-46a1-8766-0cb34e8adcfa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:58.015397 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6086f68b-581f-46a1-8766-0cb34e8adcfa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:58.016295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6086f68b-581f-46a1-8766-0cb34e8adcfa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:58.017140 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6086f68b-581f-46a1-8766-0cb34e8adcfa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:58.021237 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-01012da8-9c5a-4eb7-98ea-7ebf1fa70c92 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:58.035046 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-01012da8-9c5a-4eb7-98ea-7ebf1fa70c92 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1501 microversion: 2.1 time: 0.169292 Jun 22 16:59:58.035617 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 64/118] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:57 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 16:59:58.155751 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6086f68b-581f-46a1-8766-0cb34e8adcfa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:58.163355 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6086f68b-581f-46a1-8766-0cb34e8adcfa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.160463 Jun 22 16:59:58.163946 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 55/119] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:58 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 16:59:59.179890 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3c4d6695-0ae3-41b8-b69c-84925f4548b6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 16:59:59.180517 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3c4d6695-0ae3-41b8-b69c-84925f4548b6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 16:59:59.186489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3c4d6695-0ae3-41b8-b69c-84925f4548b6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:59.186929 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3c4d6695-0ae3-41b8-b69c-84925f4548b6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:59.187690 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3c4d6695-0ae3-41b8-b69c-84925f4548b6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 16:59:59.188098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3c4d6695-0ae3-41b8-b69c-84925f4548b6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 16:59:59.316427 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3c4d6695-0ae3-41b8-b69c-84925f4548b6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 16:59:59.324376 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3c4d6695-0ae3-41b8-b69c-84925f4548b6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.148219 Jun 22 16:59:59.324926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 65/120] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 16:59:59 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:00.341325 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-87bff902-18a8-49e5-b5b2-cc9a230e0a70 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:00.341934 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-87bff902-18a8-49e5-b5b2-cc9a230e0a70 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:00.347924 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-87bff902-18a8-49e5-b5b2-cc9a230e0a70 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:00.348391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-87bff902-18a8-49e5-b5b2-cc9a230e0a70 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:00.349142 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-87bff902-18a8-49e5-b5b2-cc9a230e0a70 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:00.349567 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-87bff902-18a8-49e5-b5b2-cc9a230e0a70 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:00.480188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-87bff902-18a8-49e5-b5b2-cc9a230e0a70 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:00.487456 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-87bff902-18a8-49e5-b5b2-cc9a230e0a70 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.150648 Jun 22 17:00:00.488008 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 56/121] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:00 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:01.504234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-950d0a15-5a4d-4181-817f-0cd2a6146f13 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:01.504778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-950d0a15-5a4d-4181-817f-0cd2a6146f13 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:01.506795 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=56 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:01.511477 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-950d0a15-5a4d-4181-817f-0cd2a6146f13 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:01.511922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-950d0a15-5a4d-4181-817f-0cd2a6146f13 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:01.512750 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-950d0a15-5a4d-4181-817f-0cd2a6146f13 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:01.513178 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-950d0a15-5a4d-4181-817f-0cd2a6146f13 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:01.648314 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-950d0a15-5a4d-4181-817f-0cd2a6146f13 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:01.650899 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-950d0a15-5a4d-4181-817f-0cd2a6146f13 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.150799 Jun 22 17:00:01.651446 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 66/122] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:01 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:01.834449 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2012807129", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "networks": [{"uuid": "96204897-f870-4e58-a7fb-14aa776c9faa"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:01.841795 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=56 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:01.886671 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] validate_networks() for [('96204897-f870-4e58-a7fb-14aa776c9faa', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:00:02.257671 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:00:02.258089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:00:02.258551 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:00:02.258957 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:00:02.259358 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:00:02.269010 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:02.269452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:02.270242 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:02.270670 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:02.288228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Getting quotas for project e491322c9bb146359268dcd649f24662. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:00:02.292182 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Getting quotas for user 1fe59d1f996e4abdb8a90b7444133e1c and project e491322c9bb146359268dcd649f24662. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:00:02.303129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:00:02.305483 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:00:02.419682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9efcb8f7-b6ff-4208-80c9-64c7899583e8 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588998 Jun 22 17:00:02.420456 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 57/123] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:00:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:00:02.430433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5d3aa4f4-9686-40e3-a3f3-2a0cf99735e7 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:02.431172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5d3aa4f4-9686-40e3-a3f3-2a0cf99735e7 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:02.484732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5d3aa4f4-9686-40e3-a3f3-2a0cf99735e7 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:02.491669 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5d3aa4f4-9686-40e3-a3f3-2a0cf99735e7 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1214 microversion: 2.1 time: 0.065135 Jun 22 17:00:02.492263 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 67/124] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:02 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:02.667794 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e55e6dfa-c3aa-4552-9315-ee3ce04238b1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:02.668524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e55e6dfa-c3aa-4552-9315-ee3ce04238b1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:02.674547 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e55e6dfa-c3aa-4552-9315-ee3ce04238b1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:02.675021 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e55e6dfa-c3aa-4552-9315-ee3ce04238b1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:02.675751 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e55e6dfa-c3aa-4552-9315-ee3ce04238b1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:02.676215 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e55e6dfa-c3aa-4552-9315-ee3ce04238b1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:02.816810 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e55e6dfa-c3aa-4552-9315-ee3ce04238b1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:02.825305 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e55e6dfa-c3aa-4552-9315-ee3ce04238b1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1322 microversion: 2.1 time: 0.161384 Jun 22 17:00:02.827251 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 58/125] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:02 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:02.938422 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2c90dc65-06bb-4af9-87e2-888520880281 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b2324db-419e-4ac3-91af-e77f0d998deb"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:02.940064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2c90dc65-06bb-4af9-87e2-888520880281 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:02.946743 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c90dc65-06bb-4af9-87e2-888520880281 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:02.947986 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c90dc65-06bb-4af9-87e2-888520880281 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:02.948952 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c90dc65-06bb-4af9-87e2-888520880281 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:02.949526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c90dc65-06bb-4af9-87e2-888520880281 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:03.509233 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d16a515a-3582-4e24-b6b8-55f6eca5b686 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:03.510692 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d16a515a-3582-4e24-b6b8-55f6eca5b686 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:03.573051 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d16a515a-3582-4e24-b6b8-55f6eca5b686 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:03.581501 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d16a515a-3582-4e24-b6b8-55f6eca5b686 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1214 microversion: 2.1 time: 0.076635 Jun 22 17:00:03.581942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 59/126] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:03 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:03.842788 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a5da5885-b508-40e5-902e-d4b6a2866c0b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:03.843397 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a5da5885-b508-40e5-902e-d4b6a2866c0b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:03.850733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5da5885-b508-40e5-902e-d4b6a2866c0b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:03.851807 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5da5885-b508-40e5-902e-d4b6a2866c0b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:03.854123 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5da5885-b508-40e5-902e-d4b6a2866c0b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:03.854654 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5da5885-b508-40e5-902e-d4b6a2866c0b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:04.016277 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a5da5885-b508-40e5-902e-d4b6a2866c0b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:04.024903 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a5da5885-b508-40e5-902e-d4b6a2866c0b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1515 microversion: 2.1 time: 0.185854 Jun 22 17:00:04.025903 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 60/127] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:03 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:04.043431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-44d96a5d-620c-40f5-9046-806793033be1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:04.044539 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-44d96a5d-620c-40f5-9046-806793033be1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:04.050531 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44d96a5d-620c-40f5-9046-806793033be1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:04.050968 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44d96a5d-620c-40f5-9046-806793033be1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:04.051717 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44d96a5d-620c-40f5-9046-806793033be1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:04.052169 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44d96a5d-620c-40f5-9046-806793033be1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:04.081231 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:04.116450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-44d96a5d-620c-40f5-9046-806793033be1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lazy-loading 'flavor' on Instance uuid 18dde809-575a-4930-b8f5-c7e39aee3f0b {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:00:04.160456 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:04.395138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2c90dc65-06bb-4af9-87e2-888520880281 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "POST /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.461626 Jun 22 17:00:04.395934 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 68/128] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:00:02 2022] POST /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6/os-volume_attachments => generated 194 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:00:04.542180 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-44d96a5d-620c-40f5-9046-806793033be1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b/action" status: 200 len: 32 microversion: 2.1 time: 0.503016 Jun 22 17:00:04.543035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 61/129] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:00:04 2022] POST /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b/action => generated 32 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 17:00:04.555128 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6af9cc12-593f-40f7-b2e6-6ecafb8c57d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:04.556281 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6af9cc12-593f-40f7-b2e6-6ecafb8c57d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:04.565170 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6af9cc12-593f-40f7-b2e6-6ecafb8c57d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:04.566516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6af9cc12-593f-40f7-b2e6-6ecafb8c57d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:04.567308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6af9cc12-593f-40f7-b2e6-6ecafb8c57d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:04.567734 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6af9cc12-593f-40f7-b2e6-6ecafb8c57d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:04.605190 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-067c323a-50e7-4750-bce8-77bac5281648 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:04.606206 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-067c323a-50e7-4750-bce8-77bac5281648 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:04.614368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-067c323a-50e7-4750-bce8-77bac5281648 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:04.615338 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-067c323a-50e7-4750-bce8-77bac5281648 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:04.616964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-067c323a-50e7-4750-bce8-77bac5281648 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:04.618747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-067c323a-50e7-4750-bce8-77bac5281648 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:04.688568 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-067c323a-50e7-4750-bce8-77bac5281648 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:04.697812 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-067c323a-50e7-4750-bce8-77bac5281648 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1218 microversion: 2.1 time: 0.098234 Jun 22 17:00:04.698888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 62/130] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:04 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:04.732225 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6af9cc12-593f-40f7-b2e6-6ecafb8c57d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:04.739743 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6af9cc12-593f-40f7-b2e6-6ecafb8c57d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.188934 Jun 22 17:00:04.740332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 69/131] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:04 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:05.714026 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f72ff03e-57bb-463a-885c-e3c424514d38 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:05.714967 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f72ff03e-57bb-463a-885c-e3c424514d38 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:05.721190 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f72ff03e-57bb-463a-885c-e3c424514d38 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:05.721639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f72ff03e-57bb-463a-885c-e3c424514d38 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:05.722395 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f72ff03e-57bb-463a-885c-e3c424514d38 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:05.722983 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f72ff03e-57bb-463a-885c-e3c424514d38 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:05.762008 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ebe43815-e0f2-435b-a987-d1afc32c40d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:05.763493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ebe43815-e0f2-435b-a987-d1afc32c40d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:05.779847 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ebe43815-e0f2-435b-a987-d1afc32c40d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:05.780841 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ebe43815-e0f2-435b-a987-d1afc32c40d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:05.783154 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ebe43815-e0f2-435b-a987-d1afc32c40d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:05.783865 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ebe43815-e0f2-435b-a987-d1afc32c40d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:05.800681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f72ff03e-57bb-463a-885c-e3c424514d38 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:05.808952 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f72ff03e-57bb-463a-885c-e3c424514d38 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1218 microversion: 2.1 time: 0.099077 Jun 22 17:00:05.809988 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 63/132] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:05 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:05.950822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ebe43815-e0f2-435b-a987-d1afc32c40d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:05.960568 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ebe43815-e0f2-435b-a987-d1afc32c40d0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.207159 Jun 22 17:00:05.970874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 70/133] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:05 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:06.830541 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cd68d990-22ee-4d3d-90a9-25ac40963973 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:06.831141 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cd68d990-22ee-4d3d-90a9-25ac40963973 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:06.837670 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd68d990-22ee-4d3d-90a9-25ac40963973 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:06.838450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd68d990-22ee-4d3d-90a9-25ac40963973 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:06.839736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd68d990-22ee-4d3d-90a9-25ac40963973 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:06.840964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd68d990-22ee-4d3d-90a9-25ac40963973 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:06.912640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cd68d990-22ee-4d3d-90a9-25ac40963973 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:06.923411 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cd68d990-22ee-4d3d-90a9-25ac40963973 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1218 microversion: 2.1 time: 0.096627 Jun 22 17:00:06.924883 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 64/134] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:06 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:06.979479 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d11102a9-581e-4af4-8627-06996ea68edf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:06.980089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d11102a9-581e-4af4-8627-06996ea68edf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:06.986660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d11102a9-581e-4af4-8627-06996ea68edf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:06.987108 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d11102a9-581e-4af4-8627-06996ea68edf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:06.988014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d11102a9-581e-4af4-8627-06996ea68edf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:06.988471 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d11102a9-581e-4af4-8627-06996ea68edf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:07.125925 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d11102a9-581e-4af4-8627-06996ea68edf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:07.133420 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d11102a9-581e-4af4-8627-06996ea68edf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.158478 Jun 22 17:00:07.133982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 71/135] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:06 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:07.941495 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3c9088da-4082-42f1-bbe3-b6eeaa7e841c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:07.942090 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3c9088da-4082-42f1-bbe3-b6eeaa7e841c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:07.948867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3c9088da-4082-42f1-bbe3-b6eeaa7e841c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:07.949404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3c9088da-4082-42f1-bbe3-b6eeaa7e841c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:07.950239 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3c9088da-4082-42f1-bbe3-b6eeaa7e841c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:07.950739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3c9088da-4082-42f1-bbe3-b6eeaa7e841c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:08.023155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3c9088da-4082-42f1-bbe3-b6eeaa7e841c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:08.031857 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3c9088da-4082-42f1-bbe3-b6eeaa7e841c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1218 microversion: 2.1 time: 0.094185 Jun 22 17:00:08.043810 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 65/136] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:07 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:08.150759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-01cf4fec-61e5-43d9-a5ad-8d1190c86410 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:08.151367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-01cf4fec-61e5-43d9-a5ad-8d1190c86410 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:08.158165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01cf4fec-61e5-43d9-a5ad-8d1190c86410 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:08.158610 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01cf4fec-61e5-43d9-a5ad-8d1190c86410 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:08.159373 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01cf4fec-61e5-43d9-a5ad-8d1190c86410 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:08.159804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01cf4fec-61e5-43d9-a5ad-8d1190c86410 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:08.300168 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-01cf4fec-61e5-43d9-a5ad-8d1190c86410 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:08.312327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-01cf4fec-61e5-43d9-a5ad-8d1190c86410 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.164229 Jun 22 17:00:08.312903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 72/137] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:08 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:09.050772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-df9af9ff-fd7b-4c06-a03a-2d681e8b4a0e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:09.051454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-df9af9ff-fd7b-4c06-a03a-2d681e8b4a0e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:09.057692 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df9af9ff-fd7b-4c06-a03a-2d681e8b4a0e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:09.058143 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df9af9ff-fd7b-4c06-a03a-2d681e8b4a0e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:09.058961 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df9af9ff-fd7b-4c06-a03a-2d681e8b4a0e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:09.059390 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df9af9ff-fd7b-4c06-a03a-2d681e8b4a0e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:09.142452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-df9af9ff-fd7b-4c06-a03a-2d681e8b4a0e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:09.149999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-df9af9ff-fd7b-4c06-a03a-2d681e8b4a0e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1266 microversion: 2.1 time: 0.103399 Jun 22 17:00:09.151149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 66/138] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:09 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:09.329341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-069581e2-2adb-47cf-be04-44b867d7706a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:09.330012 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-069581e2-2adb-47cf-be04-44b867d7706a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:09.336766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-069581e2-2adb-47cf-be04-44b867d7706a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:09.337404 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-069581e2-2adb-47cf-be04-44b867d7706a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:09.338950 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-069581e2-2adb-47cf-be04-44b867d7706a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:09.339532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-069581e2-2adb-47cf-be04-44b867d7706a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:09.470055 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-069581e2-2adb-47cf-be04-44b867d7706a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:09.478571 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-069581e2-2adb-47cf-be04-44b867d7706a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.153013 Jun 22 17:00:09.479313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 73/139] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:09 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:10.173318 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-851871d8-b057-4bc6-b0c8-56a2acddf7e5 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:10.174015 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-851871d8-b057-4bc6-b0c8-56a2acddf7e5 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:10.195810 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-851871d8-b057-4bc6-b0c8-56a2acddf7e5 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:10.196259 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-851871d8-b057-4bc6-b0c8-56a2acddf7e5 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:10.197046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-851871d8-b057-4bc6-b0c8-56a2acddf7e5 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:10.197556 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-851871d8-b057-4bc6-b0c8-56a2acddf7e5 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:10.411794 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-851871d8-b057-4bc6-b0c8-56a2acddf7e5 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:10.419974 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-851871d8-b057-4bc6-b0c8-56a2acddf7e5 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.251238 Jun 22 17:00:10.420913 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 67/140] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:10 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:10.495990 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f711c702-acc1-4c53-8972-f359df5df261 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:10.496721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f711c702-acc1-4c53-8972-f359df5df261 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:10.503725 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f711c702-acc1-4c53-8972-f359df5df261 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:10.504206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f711c702-acc1-4c53-8972-f359df5df261 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:10.504962 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f711c702-acc1-4c53-8972-f359df5df261 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:10.505561 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f711c702-acc1-4c53-8972-f359df5df261 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:10.641610 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f711c702-acc1-4c53-8972-f359df5df261 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:10.649302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f711c702-acc1-4c53-8972-f359df5df261 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.158262 Jun 22 17:00:10.650327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 74/141] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:10 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:11.200573 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-fece0e0c-6a40-4de8-8bfd-ab4badfe5e8c req-b90111b3-c550-408f-b94f-d73be985cba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340a3a73-4163-440a-8034-ee1fcb52e1ce", "tag": "f278e67f-0609-4704-a164-6f6c20a8135e"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:11.221050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fece0e0c-6a40-4de8-8bfd-ab4badfe5e8c req-b90111b3-c550-408f-b94f-d73be985cba3 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:11.221497 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fece0e0c-6a40-4de8-8bfd-ab4badfe5e8c req-b90111b3-c550-408f-b94f-d73be985cba3 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:11.238459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-fece0e0c-6a40-4de8-8bfd-ab4badfe5e8c req-b90111b3-c550-408f-b94f-d73be985cba3 service nova] Creating event network-changed:f278e67f-0609-4704-a164-6f6c20a8135e for instance 340a3a73-4163-440a-8034-ee1fcb52e1ce on hv-cinder-81045 Jun 22 17:00:11.246547 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-fece0e0c-6a40-4de8-8bfd-ab4badfe5e8c req-b90111b3-c550-408f-b94f-d73be985cba3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050143 Jun 22 17:00:11.248090 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 68/142] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:00:11.438598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-eab52b88-e027-4fb1-aaa2-9312198b2398 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:11.438598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-eab52b88-e027-4fb1-aaa2-9312198b2398 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:11.446718 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eab52b88-e027-4fb1-aaa2-9312198b2398 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:11.447978 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eab52b88-e027-4fb1-aaa2-9312198b2398 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:11.448955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eab52b88-e027-4fb1-aaa2-9312198b2398 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:11.450121 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eab52b88-e027-4fb1-aaa2-9312198b2398 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:11.606470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-eab52b88-e027-4fb1-aaa2-9312198b2398 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:11.617121 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-eab52b88-e027-4fb1-aaa2-9312198b2398 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.183208 Jun 22 17:00:11.617745 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 75/143] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:11 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:11.670158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c50c608e-b99f-4a36-a04f-7ac15266b9d4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:11.672387 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c50c608e-b99f-4a36-a04f-7ac15266b9d4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:11.681229 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c50c608e-b99f-4a36-a04f-7ac15266b9d4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:11.681719 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c50c608e-b99f-4a36-a04f-7ac15266b9d4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:11.683282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c50c608e-b99f-4a36-a04f-7ac15266b9d4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:11.683908 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c50c608e-b99f-4a36-a04f-7ac15266b9d4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:11.894220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c50c608e-b99f-4a36-a04f-7ac15266b9d4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:11.902482 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c50c608e-b99f-4a36-a04f-7ac15266b9d4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.237752 Jun 22 17:00:11.903047 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 69/144] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:11 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:12.637389 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-54ec72f4-b28f-42cb-a833-f82b377e9bfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:12.640213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-54ec72f4-b28f-42cb-a833-f82b377e9bfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:12.643603 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:12.646079 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-54ec72f4-b28f-42cb-a833-f82b377e9bfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:12.646909 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-54ec72f4-b28f-42cb-a833-f82b377e9bfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:12.649216 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-54ec72f4-b28f-42cb-a833-f82b377e9bfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:12.649806 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-54ec72f4-b28f-42cb-a833-f82b377e9bfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:12.808803 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-54ec72f4-b28f-42cb-a833-f82b377e9bfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:12.817501 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-54ec72f4-b28f-42cb-a833-f82b377e9bfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.185471 Jun 22 17:00:12.818074 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 76/145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:12 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:12.919358 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8d29ee8f-b366-4396-827e-55f19c1ae561 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:12.919970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8d29ee8f-b366-4396-827e-55f19c1ae561 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:12.922073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:12.927577 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8d29ee8f-b366-4396-827e-55f19c1ae561 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:12.928091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8d29ee8f-b366-4396-827e-55f19c1ae561 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:12.928960 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8d29ee8f-b366-4396-827e-55f19c1ae561 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:12.929391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8d29ee8f-b366-4396-827e-55f19c1ae561 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:13.069740 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8d29ee8f-b366-4396-827e-55f19c1ae561 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:13.081821 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8d29ee8f-b366-4396-827e-55f19c1ae561 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.166673 Jun 22 17:00:13.090349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 70/146] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:12 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:13.834221 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7c6203a4-4c54-4dd1-995e-e79a9639df5f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:13.834852 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7c6203a4-4c54-4dd1-995e-e79a9639df5f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:13.842138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c6203a4-4c54-4dd1-995e-e79a9639df5f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:13.842577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c6203a4-4c54-4dd1-995e-e79a9639df5f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:13.843363 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c6203a4-4c54-4dd1-995e-e79a9639df5f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:13.843957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c6203a4-4c54-4dd1-995e-e79a9639df5f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:13.972437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7c6203a4-4c54-4dd1-995e-e79a9639df5f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:13.980307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7c6203a4-4c54-4dd1-995e-e79a9639df5f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.149834 Jun 22 17:00:13.982064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 77/147] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:13 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:14.100605 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c846336d-50fd-4737-9a0b-a845422d2c9e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:14.101429 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c846336d-50fd-4737-9a0b-a845422d2c9e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:14.103206 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=8 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:14.108647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c846336d-50fd-4737-9a0b-a845422d2c9e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:14.109093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c846336d-50fd-4737-9a0b-a845422d2c9e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:14.110023 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c846336d-50fd-4737-9a0b-a845422d2c9e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:14.110485 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c846336d-50fd-4737-9a0b-a845422d2c9e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:14.252732 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c846336d-50fd-4737-9a0b-a845422d2c9e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:14.260679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c846336d-50fd-4737-9a0b-a845422d2c9e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.163722 Jun 22 17:00:14.261244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 71/148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:14 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:14.998398 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-43a84b12-bfae-4fdd-998d-5ac201019591 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:14.999014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-43a84b12-bfae-4fdd-998d-5ac201019591 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:15.005465 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43a84b12-bfae-4fdd-998d-5ac201019591 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:15.005915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43a84b12-bfae-4fdd-998d-5ac201019591 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:15.006670 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43a84b12-bfae-4fdd-998d-5ac201019591 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:15.007094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43a84b12-bfae-4fdd-998d-5ac201019591 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:15.138085 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-43a84b12-bfae-4fdd-998d-5ac201019591 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:15.145540 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-43a84b12-bfae-4fdd-998d-5ac201019591 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.151429 Jun 22 17:00:15.146107 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 78/149] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:14 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:15.277993 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e299b05a-703c-462e-b40b-467480ed7318 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:15.278638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e299b05a-703c-462e-b40b-467480ed7318 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:15.285227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e299b05a-703c-462e-b40b-467480ed7318 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:15.285674 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e299b05a-703c-462e-b40b-467480ed7318 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:15.286441 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e299b05a-703c-462e-b40b-467480ed7318 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:15.286973 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e299b05a-703c-462e-b40b-467480ed7318 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:15.425485 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e299b05a-703c-462e-b40b-467480ed7318 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:15.434076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e299b05a-703c-462e-b40b-467480ed7318 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.160769 Jun 22 17:00:15.434788 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 72/150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:15 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:16.162733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2d0eae80-42ae-43e4-bba4-119934b6bbfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:16.163345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2d0eae80-42ae-43e4-bba4-119934b6bbfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:16.170345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2d0eae80-42ae-43e4-bba4-119934b6bbfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:16.170794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2d0eae80-42ae-43e4-bba4-119934b6bbfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:16.171560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2d0eae80-42ae-43e4-bba4-119934b6bbfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:16.171995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2d0eae80-42ae-43e4-bba4-119934b6bbfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:16.298255 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2d0eae80-42ae-43e4-bba4-119934b6bbfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:16.305736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2d0eae80-42ae-43e4-bba4-119934b6bbfa tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.146894 Jun 22 17:00:16.306309 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 79/151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:16 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:16.451333 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-83b2c494-616b-4024-bfd6-1add67693b64 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:16.451966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-83b2c494-616b-4024-bfd6-1add67693b64 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:16.458004 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83b2c494-616b-4024-bfd6-1add67693b64 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:16.458431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83b2c494-616b-4024-bfd6-1add67693b64 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:16.459182 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83b2c494-616b-4024-bfd6-1add67693b64 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:16.459605 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83b2c494-616b-4024-bfd6-1add67693b64 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:16.594285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-83b2c494-616b-4024-bfd6-1add67693b64 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:16.601596 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-83b2c494-616b-4024-bfd6-1add67693b64 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.154594 Jun 22 17:00:16.602180 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 73/152] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:16 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:17.322564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2f06cbab-b707-4e46-9b20-c84a5e829c29 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:17.323097 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2f06cbab-b707-4e46-9b20-c84a5e829c29 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:17.329580 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f06cbab-b707-4e46-9b20-c84a5e829c29 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:17.330019 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f06cbab-b707-4e46-9b20-c84a5e829c29 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:17.330760 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f06cbab-b707-4e46-9b20-c84a5e829c29 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:17.331229 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f06cbab-b707-4e46-9b20-c84a5e829c29 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:17.461971 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2f06cbab-b707-4e46-9b20-c84a5e829c29 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:17.469318 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2f06cbab-b707-4e46-9b20-c84a5e829c29 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.150838 Jun 22 17:00:17.469871 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 80/153] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:17 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:17.618312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2b2d8fc3-fab3-46fd-bd7b-b4c53cfd89a9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:17.618918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2b2d8fc3-fab3-46fd-bd7b-b4c53cfd89a9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:17.624931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fc3-fab3-46fd-bd7b-b4c53cfd89a9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:17.625375 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fc3-fab3-46fd-bd7b-b4c53cfd89a9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:17.626128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fc3-fab3-46fd-bd7b-b4c53cfd89a9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:17.626557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b2d8fc3-fab3-46fd-bd7b-b4c53cfd89a9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:17.750960 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2b2d8fc3-fab3-46fd-bd7b-b4c53cfd89a9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:17.758451 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2b2d8fc3-fab3-46fd-bd7b-b4c53cfd89a9 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.143959 Jun 22 17:00:17.759009 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 74/154] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:17 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:18.486663 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-514e25fb-e8d3-4575-8c39-9084758349d4 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:18.487266 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-514e25fb-e8d3-4575-8c39-9084758349d4 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:18.493695 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-514e25fb-e8d3-4575-8c39-9084758349d4 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:18.494135 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-514e25fb-e8d3-4575-8c39-9084758349d4 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:18.494890 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-514e25fb-e8d3-4575-8c39-9084758349d4 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:18.495827 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-514e25fb-e8d3-4575-8c39-9084758349d4 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:18.627103 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-514e25fb-e8d3-4575-8c39-9084758349d4 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:18.634456 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-514e25fb-e8d3-4575-8c39-9084758349d4 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.151629 Jun 22 17:00:18.635008 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 81/155] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:18 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:18.774404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a05a4b9f-a0f2-4570-87de-ff366d520a03 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:18.775999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a05a4b9f-a0f2-4570-87de-ff366d520a03 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:18.782696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a05a4b9f-a0f2-4570-87de-ff366d520a03 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:18.783143 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a05a4b9f-a0f2-4570-87de-ff366d520a03 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:18.783911 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a05a4b9f-a0f2-4570-87de-ff366d520a03 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:18.784545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a05a4b9f-a0f2-4570-87de-ff366d520a03 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:18.915315 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a05a4b9f-a0f2-4570-87de-ff366d520a03 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:18.923512 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a05a4b9f-a0f2-4570-87de-ff366d520a03 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.152841 Jun 22 17:00:18.924088 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 75/156] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:18 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:19.651215 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b9173368-ee6a-4e1a-bbc1-d238e6d5231d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:19.652468 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b9173368-ee6a-4e1a-bbc1-d238e6d5231d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:19.658915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b9173368-ee6a-4e1a-bbc1-d238e6d5231d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:19.659365 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b9173368-ee6a-4e1a-bbc1-d238e6d5231d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:19.660131 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b9173368-ee6a-4e1a-bbc1-d238e6d5231d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:19.660614 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b9173368-ee6a-4e1a-bbc1-d238e6d5231d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:19.788590 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b9173368-ee6a-4e1a-bbc1-d238e6d5231d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:19.795928 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b9173368-ee6a-4e1a-bbc1-d238e6d5231d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.148637 Jun 22 17:00:19.796500 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 82/157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:19 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:19.941019 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e2ad0812-afed-43ce-a9c0-99d31f380881 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:19.941657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e2ad0812-afed-43ce-a9c0-99d31f380881 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:19.947773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e2ad0812-afed-43ce-a9c0-99d31f380881 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:19.948248 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e2ad0812-afed-43ce-a9c0-99d31f380881 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:19.949550 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e2ad0812-afed-43ce-a9c0-99d31f380881 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:19.949978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e2ad0812-afed-43ce-a9c0-99d31f380881 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:19.974427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:20.105469 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e2ad0812-afed-43ce-a9c0-99d31f380881 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:20.113000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e2ad0812-afed-43ce-a9c0-99d31f380881 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.175812 Jun 22 17:00:20.113558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 76/158] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:19 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:20.812387 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-260dd085-30ca-4250-9d87-2b76c0a88aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:20.813251 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-260dd085-30ca-4250-9d87-2b76c0a88aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:20.819639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-260dd085-30ca-4250-9d87-2b76c0a88aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:20.820088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-260dd085-30ca-4250-9d87-2b76c0a88aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:20.820881 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-260dd085-30ca-4250-9d87-2b76c0a88aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:20.821322 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-260dd085-30ca-4250-9d87-2b76c0a88aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:20.949913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-260dd085-30ca-4250-9d87-2b76c0a88aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:20.968954 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-260dd085-30ca-4250-9d87-2b76c0a88aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.160469 Jun 22 17:00:20.969535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 83/159] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:20 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:21.131914 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-511f5798-9f6b-4bd0-9e96-3d747f220f65 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:21.133286 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-511f5798-9f6b-4bd0-9e96-3d747f220f65 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:21.141099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-511f5798-9f6b-4bd0-9e96-3d747f220f65 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:21.141536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-511f5798-9f6b-4bd0-9e96-3d747f220f65 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:21.142290 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-511f5798-9f6b-4bd0-9e96-3d747f220f65 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:21.142712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-511f5798-9f6b-4bd0-9e96-3d747f220f65 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:21.281224 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-511f5798-9f6b-4bd0-9e96-3d747f220f65 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:21.288545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-511f5798-9f6b-4bd0-9e96-3d747f220f65 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.162159 Jun 22 17:00:21.289096 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 77/160] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:21 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:21.985837 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6b8e088c-52c5-4e89-b04e-997d92b0b642 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:21.986429 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6b8e088c-52c5-4e89-b04e-997d92b0b642 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:21.992914 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6b8e088c-52c5-4e89-b04e-997d92b0b642 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:21.993371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6b8e088c-52c5-4e89-b04e-997d92b0b642 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:21.994118 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6b8e088c-52c5-4e89-b04e-997d92b0b642 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:21.994642 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6b8e088c-52c5-4e89-b04e-997d92b0b642 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:22.151961 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6b8e088c-52c5-4e89-b04e-997d92b0b642 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:22.156318 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:22.160905 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6b8e088c-52c5-4e89-b04e-997d92b0b642 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.179083 Jun 22 17:00:22.161475 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 84/161] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:21 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:22.305436 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-54393bf2-6f3b-411b-b8ce-8486208da805 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:22.306042 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-54393bf2-6f3b-411b-b8ce-8486208da805 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:22.313679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54393bf2-6f3b-411b-b8ce-8486208da805 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:22.313679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54393bf2-6f3b-411b-b8ce-8486208da805 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:22.313679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54393bf2-6f3b-411b-b8ce-8486208da805 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:22.314016 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54393bf2-6f3b-411b-b8ce-8486208da805 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:22.457729 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-54393bf2-6f3b-411b-b8ce-8486208da805 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:22.466076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-54393bf2-6f3b-411b-b8ce-8486208da805 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.164124 Jun 22 17:00:22.466710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 78/162] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:22 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:23.178819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9d24daf7-986d-4558-bdff-a1534b00f1d6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:23.179528 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9d24daf7-986d-4558-bdff-a1534b00f1d6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:23.192759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9d24daf7-986d-4558-bdff-a1534b00f1d6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:23.193218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9d24daf7-986d-4558-bdff-a1534b00f1d6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:23.194170 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9d24daf7-986d-4558-bdff-a1534b00f1d6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:23.194629 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9d24daf7-986d-4558-bdff-a1534b00f1d6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:23.403775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9d24daf7-986d-4558-bdff-a1534b00f1d6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:23.410719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9d24daf7-986d-4558-bdff-a1534b00f1d6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.236205 Jun 22 17:00:23.411328 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 85/163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:23 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:23.450363 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7affa2c-ac3a-4363-9d34-ccf2c29d6cf4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:23.451118 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7affa2c-ac3a-4363-9d34-ccf2c29d6cf4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:23.457407 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7affa2c-ac3a-4363-9d34-ccf2c29d6cf4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:23.457966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7affa2c-ac3a-4363-9d34-ccf2c29d6cf4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:23.458877 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7affa2c-ac3a-4363-9d34-ccf2c29d6cf4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:23.459500 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7affa2c-ac3a-4363-9d34-ccf2c29d6cf4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:23.483300 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cb6103aa-8f0a-42cd-87bf-6e372d3f7359 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:23.483908 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-cb6103aa-8f0a-42cd-87bf-6e372d3f7359 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:23.485985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7affa2c-ac3a-4363-9d34-ccf2c29d6cf4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:00:23.489858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cb6103aa-8f0a-42cd-87bf-6e372d3f7359 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:23.490305 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cb6103aa-8f0a-42cd-87bf-6e372d3f7359 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:23.491064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cb6103aa-8f0a-42cd-87bf-6e372d3f7359 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:23.491495 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cb6103aa-8f0a-42cd-87bf-6e372d3f7359 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:23.641489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cb6103aa-8f0a-42cd-87bf-6e372d3f7359 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:23.649334 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cb6103aa-8f0a-42cd-87bf-6e372d3f7359 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.170308 Jun 22 17:00:23.653447 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 86/164] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:23 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:23.837594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7affa2c-ac3a-4363-9d34-ccf2c29d6cf4 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 204 len: 0 microversion: 2.1 time: 0.390731 Jun 22 17:00:23.838708 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 79/165] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:00:23 2022] DELETE /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:00:23.847935 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2f5c823b-e682-42f6-aeef-543b23f8d18d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:23.848759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2f5c823b-e682-42f6-aeef-543b23f8d18d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:23.857067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f5c823b-e682-42f6-aeef-543b23f8d18d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:23.858044 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f5c823b-e682-42f6-aeef-543b23f8d18d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:23.859069 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f5c823b-e682-42f6-aeef-543b23f8d18d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:23.859656 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f5c823b-e682-42f6-aeef-543b23f8d18d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:23.990179 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2f5c823b-e682-42f6-aeef-543b23f8d18d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:23.998473 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2f5c823b-e682-42f6-aeef-543b23f8d18d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.155360 Jun 22 17:00:23.999038 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 87/166] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:23 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:24.429251 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3ca16b17-3fd8-48f2-a66b-b055c7ace3cd tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:24.429251 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3ca16b17-3fd8-48f2-a66b-b055c7ace3cd tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:24.436010 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ca16b17-3fd8-48f2-a66b-b055c7ace3cd tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:24.436486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ca16b17-3fd8-48f2-a66b-b055c7ace3cd tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:24.437252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ca16b17-3fd8-48f2-a66b-b055c7ace3cd tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:24.437683 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ca16b17-3fd8-48f2-a66b-b055c7ace3cd tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:24.571791 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3ca16b17-3fd8-48f2-a66b-b055c7ace3cd tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:24.580194 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3ca16b17-3fd8-48f2-a66b-b055c7ace3cd tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.156328 Jun 22 17:00:24.580886 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 80/167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:24 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:24.666666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7ed136a4-0cc1-4351-9d83-e771efbfbdc8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:24.667257 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7ed136a4-0cc1-4351-9d83-e771efbfbdc8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:24.674122 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7ed136a4-0cc1-4351-9d83-e771efbfbdc8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:24.674558 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7ed136a4-0cc1-4351-9d83-e771efbfbdc8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:24.675357 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7ed136a4-0cc1-4351-9d83-e771efbfbdc8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:24.675783 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7ed136a4-0cc1-4351-9d83-e771efbfbdc8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:24.817636 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7ed136a4-0cc1-4351-9d83-e771efbfbdc8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:24.825387 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7ed136a4-0cc1-4351-9d83-e771efbfbdc8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.162567 Jun 22 17:00:24.826179 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 88/168] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:24 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:25.015250 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6dc99bd9-a3da-4d88-9655-ef448a048514 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:25.015875 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6dc99bd9-a3da-4d88-9655-ef448a048514 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:25.021797 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6dc99bd9-a3da-4d88-9655-ef448a048514 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:25.022245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6dc99bd9-a3da-4d88-9655-ef448a048514 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:25.023009 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6dc99bd9-a3da-4d88-9655-ef448a048514 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:25.023443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6dc99bd9-a3da-4d88-9655-ef448a048514 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:25.152319 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6dc99bd9-a3da-4d88-9655-ef448a048514 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:25.161175 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6dc99bd9-a3da-4d88-9655-ef448a048514 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.150075 Jun 22 17:00:25.162179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 81/169] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:25 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:25.597259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-27f851ba-125a-4d48-a2b1-ff5ffaf4cf8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:25.597902 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-27f851ba-125a-4d48-a2b1-ff5ffaf4cf8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:25.603746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-27f851ba-125a-4d48-a2b1-ff5ffaf4cf8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:25.604230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-27f851ba-125a-4d48-a2b1-ff5ffaf4cf8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:25.604999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-27f851ba-125a-4d48-a2b1-ff5ffaf4cf8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:25.605433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-27f851ba-125a-4d48-a2b1-ff5ffaf4cf8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:25.733539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-27f851ba-125a-4d48-a2b1-ff5ffaf4cf8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:25.740977 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-27f851ba-125a-4d48-a2b1-ff5ffaf4cf8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.147809 Jun 22 17:00:25.741552 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 89/170] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:25 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:25.842105 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d04c13d4-4410-4636-ae20-01fa50897d27 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:25.842707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d04c13d4-4410-4636-ae20-01fa50897d27 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:25.848793 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d04c13d4-4410-4636-ae20-01fa50897d27 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:25.849243 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d04c13d4-4410-4636-ae20-01fa50897d27 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:25.850001 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d04c13d4-4410-4636-ae20-01fa50897d27 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:25.850439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d04c13d4-4410-4636-ae20-01fa50897d27 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:25.988382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d04c13d4-4410-4636-ae20-01fa50897d27 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:25.995831 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d04c13d4-4410-4636-ae20-01fa50897d27 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.158032 Jun 22 17:00:25.996463 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 82/171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:25 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:26.177653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-315686b4-7251-4f4b-9d30-026b239ffd86 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:26.178259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-315686b4-7251-4f4b-9d30-026b239ffd86 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:26.184084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-315686b4-7251-4f4b-9d30-026b239ffd86 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:26.184552 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-315686b4-7251-4f4b-9d30-026b239ffd86 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:26.185300 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-315686b4-7251-4f4b-9d30-026b239ffd86 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:26.185734 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-315686b4-7251-4f4b-9d30-026b239ffd86 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:26.487518 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-315686b4-7251-4f4b-9d30-026b239ffd86 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:26.495616 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-315686b4-7251-4f4b-9d30-026b239ffd86 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.321677 Jun 22 17:00:26.502619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 90/172] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:26 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:26.758535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5b906d32-fce5-4a99-b700-e882a5b132db tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:26.759184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5b906d32-fce5-4a99-b700-e882a5b132db tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:26.766034 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b906d32-fce5-4a99-b700-e882a5b132db tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:26.766976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b906d32-fce5-4a99-b700-e882a5b132db tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:26.768071 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b906d32-fce5-4a99-b700-e882a5b132db tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:26.768676 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b906d32-fce5-4a99-b700-e882a5b132db tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:26.909544 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5b906d32-fce5-4a99-b700-e882a5b132db tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:26.916875 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5b906d32-fce5-4a99-b700-e882a5b132db tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.162344 Jun 22 17:00:26.917517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 83/173] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:26 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:27.012946 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9c3f76f2-bfe8-43fa-9092-83865a6926de tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:27.013592 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9c3f76f2-bfe8-43fa-9092-83865a6926de tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:27.020090 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c3f76f2-bfe8-43fa-9092-83865a6926de tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:27.020564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c3f76f2-bfe8-43fa-9092-83865a6926de tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:27.021492 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c3f76f2-bfe8-43fa-9092-83865a6926de tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:27.021937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c3f76f2-bfe8-43fa-9092-83865a6926de tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:27.152858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9c3f76f2-bfe8-43fa-9092-83865a6926de tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:27.160379 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9c3f76f2-bfe8-43fa-9092-83865a6926de tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.151305 Jun 22 17:00:27.160949 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 91/174] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:27 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:27.513128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-41aa241e-456a-46fe-97f3-33961c613c6b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:27.513712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-41aa241e-456a-46fe-97f3-33961c613c6b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:27.520452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41aa241e-456a-46fe-97f3-33961c613c6b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:27.521227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41aa241e-456a-46fe-97f3-33961c613c6b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:27.521994 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41aa241e-456a-46fe-97f3-33961c613c6b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:27.522425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41aa241e-456a-46fe-97f3-33961c613c6b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:27.648958 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-41aa241e-456a-46fe-97f3-33961c613c6b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:27.657590 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-41aa241e-456a-46fe-97f3-33961c613c6b tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.148209 Jun 22 17:00:27.658152 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 84/175] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:27 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:27.934513 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b8a8b5c1-33c9-4fc6-b2ae-8b80d20fd838 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:27.935192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b8a8b5c1-33c9-4fc6-b2ae-8b80d20fd838 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:27.941093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8a8b5c1-33c9-4fc6-b2ae-8b80d20fd838 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:27.941547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8a8b5c1-33c9-4fc6-b2ae-8b80d20fd838 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:27.942300 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8a8b5c1-33c9-4fc6-b2ae-8b80d20fd838 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:27.942761 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8a8b5c1-33c9-4fc6-b2ae-8b80d20fd838 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:28.079853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b8a8b5c1-33c9-4fc6-b2ae-8b80d20fd838 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:28.087262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b8a8b5c1-33c9-4fc6-b2ae-8b80d20fd838 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.156760 Jun 22 17:00:28.087820 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 92/176] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:27 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:28.178470 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-83c6c395-a1be-4485-a14a-061c7e6d7f49 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:28.179072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-83c6c395-a1be-4485-a14a-061c7e6d7f49 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:28.185434 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83c6c395-a1be-4485-a14a-061c7e6d7f49 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:28.185890 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83c6c395-a1be-4485-a14a-061c7e6d7f49 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:28.186625 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83c6c395-a1be-4485-a14a-061c7e6d7f49 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:28.187056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83c6c395-a1be-4485-a14a-061c7e6d7f49 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:28.314828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-83c6c395-a1be-4485-a14a-061c7e6d7f49 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:28.322038 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-83c6c395-a1be-4485-a14a-061c7e6d7f49 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.147302 Jun 22 17:00:28.322591 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 85/177] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:28 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:28.674859 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-78ea915c-e8b5-4a8e-ab76-34fd17f3d824 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:28.675401 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-78ea915c-e8b5-4a8e-ab76-34fd17f3d824 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:28.681446 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78ea915c-e8b5-4a8e-ab76-34fd17f3d824 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:28.685542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78ea915c-e8b5-4a8e-ab76-34fd17f3d824 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:28.685542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78ea915c-e8b5-4a8e-ab76-34fd17f3d824 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:28.685542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78ea915c-e8b5-4a8e-ab76-34fd17f3d824 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:28.815985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-78ea915c-e8b5-4a8e-ab76-34fd17f3d824 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:28.842604 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-78ea915c-e8b5-4a8e-ab76-34fd17f3d824 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.156863 Jun 22 17:00:28.842604 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 93/178] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:28 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:29.103543 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-de4f0071-484f-472f-82cd-62c5ce04117a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:29.104196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-de4f0071-484f-472f-82cd-62c5ce04117a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:29.113625 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de4f0071-484f-472f-82cd-62c5ce04117a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:29.114068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de4f0071-484f-472f-82cd-62c5ce04117a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:29.114911 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de4f0071-484f-472f-82cd-62c5ce04117a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:29.115337 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de4f0071-484f-472f-82cd-62c5ce04117a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:29.239932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-de4f0071-484f-472f-82cd-62c5ce04117a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:29.247724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-de4f0071-484f-472f-82cd-62c5ce04117a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.148103 Jun 22 17:00:29.248369 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 86/179] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:29 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:29.339064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ef848538-5561-4793-b2dc-7ec01cc5d631 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:29.339693 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ef848538-5561-4793-b2dc-7ec01cc5d631 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:29.346073 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ef848538-5561-4793-b2dc-7ec01cc5d631 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:29.346500 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ef848538-5561-4793-b2dc-7ec01cc5d631 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:29.347246 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ef848538-5561-4793-b2dc-7ec01cc5d631 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:29.347669 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ef848538-5561-4793-b2dc-7ec01cc5d631 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:29.477736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ef848538-5561-4793-b2dc-7ec01cc5d631 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:29.485687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ef848538-5561-4793-b2dc-7ec01cc5d631 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.150361 Jun 22 17:00:29.486239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 94/180] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:29 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:29.858375 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ab379f3d-b0c6-420e-9b3e-db73d719f895 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:29.858978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ab379f3d-b0c6-420e-9b3e-db73d719f895 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:29.865084 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ab379f3d-b0c6-420e-9b3e-db73d719f895 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:29.865528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ab379f3d-b0c6-420e-9b3e-db73d719f895 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:29.866279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ab379f3d-b0c6-420e-9b3e-db73d719f895 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:29.866706 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ab379f3d-b0c6-420e-9b3e-db73d719f895 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:29.998097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ab379f3d-b0c6-420e-9b3e-db73d719f895 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:30.006166 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ab379f3d-b0c6-420e-9b3e-db73d719f895 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.152405 Jun 22 17:00:30.014151 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 87/181] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:29 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:30.267671 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a5b332e5-b730-406f-8daf-9dd8a7de7b3e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:30.267671 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a5b332e5-b730-406f-8daf-9dd8a7de7b3e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:30.271574 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5b332e5-b730-406f-8daf-9dd8a7de7b3e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:30.272023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5b332e5-b730-406f-8daf-9dd8a7de7b3e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:30.272818 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5b332e5-b730-406f-8daf-9dd8a7de7b3e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:30.273260 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5b332e5-b730-406f-8daf-9dd8a7de7b3e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:30.399685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a5b332e5-b730-406f-8daf-9dd8a7de7b3e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:30.407935 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a5b332e5-b730-406f-8daf-9dd8a7de7b3e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.147478 Jun 22 17:00:30.408529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 95/182] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:30 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:30.502958 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f2f353ac-dcb6-43e7-83b5-b73fe6cea772 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:30.503566 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f2f353ac-dcb6-43e7-83b5-b73fe6cea772 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:30.509415 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f2f353ac-dcb6-43e7-83b5-b73fe6cea772 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:30.509864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f2f353ac-dcb6-43e7-83b5-b73fe6cea772 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:30.510686 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f2f353ac-dcb6-43e7-83b5-b73fe6cea772 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:30.511122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f2f353ac-dcb6-43e7-83b5-b73fe6cea772 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:30.635889 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f2f353ac-dcb6-43e7-83b5-b73fe6cea772 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:30.643787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f2f353ac-dcb6-43e7-83b5-b73fe6cea772 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.144574 Jun 22 17:00:30.644379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 88/183] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:30 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:31.030679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d8933df7-e963-4469-9b8d-638b9f2db50d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:31.032238 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d8933df7-e963-4469-9b8d-638b9f2db50d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:31.038376 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d8933df7-e963-4469-9b8d-638b9f2db50d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:31.038950 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d8933df7-e963-4469-9b8d-638b9f2db50d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:31.039717 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d8933df7-e963-4469-9b8d-638b9f2db50d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:31.040176 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d8933df7-e963-4469-9b8d-638b9f2db50d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:31.167918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d8933df7-e963-4469-9b8d-638b9f2db50d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:31.176361 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d8933df7-e963-4469-9b8d-638b9f2db50d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.150304 Jun 22 17:00:31.176920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 96/184] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:31 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:31.425421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-11994260-3091-4575-a2cb-a3ecc56cb532 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:31.426006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-11994260-3091-4575-a2cb-a3ecc56cb532 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:31.431999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-11994260-3091-4575-a2cb-a3ecc56cb532 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:31.432478 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-11994260-3091-4575-a2cb-a3ecc56cb532 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:31.433227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-11994260-3091-4575-a2cb-a3ecc56cb532 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:31.433656 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-11994260-3091-4575-a2cb-a3ecc56cb532 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:31.558362 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-11994260-3091-4575-a2cb-a3ecc56cb532 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:31.565756 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-11994260-3091-4575-a2cb-a3ecc56cb532 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.144279 Jun 22 17:00:31.566309 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 89/185] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:31 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:31.660864 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4fa21473-cfad-4c86-8f4f-59a44b2af884 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:31.661474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4fa21473-cfad-4c86-8f4f-59a44b2af884 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:31.663778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=64 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:31.668482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4fa21473-cfad-4c86-8f4f-59a44b2af884 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:31.668931 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4fa21473-cfad-4c86-8f4f-59a44b2af884 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:31.669698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4fa21473-cfad-4c86-8f4f-59a44b2af884 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:31.670134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4fa21473-cfad-4c86-8f4f-59a44b2af884 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:31.797604 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4fa21473-cfad-4c86-8f4f-59a44b2af884 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:31.804985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4fa21473-cfad-4c86-8f4f-59a44b2af884 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.147891 Jun 22 17:00:31.805579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 97/186] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:31 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:32.193141 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a93affac-0413-4286-9899-700ee064b6c3 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:32.193740 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a93affac-0413-4286-9899-700ee064b6c3 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:32.195656 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:32.200272 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a93affac-0413-4286-9899-700ee064b6c3 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:32.200714 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a93affac-0413-4286-9899-700ee064b6c3 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:32.201456 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a93affac-0413-4286-9899-700ee064b6c3 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:32.201944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a93affac-0413-4286-9899-700ee064b6c3 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:32.330906 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a93affac-0413-4286-9899-700ee064b6c3 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:32.338862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a93affac-0413-4286-9899-700ee064b6c3 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.149553 Jun 22 17:00:32.340320 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 90/187] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:32 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:32.582548 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3bbbbc09-176c-495b-83f5-7b43c79e3f4f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:32.589709 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-27e1e6be-6868-4b96-a8b5-56bf3d539fd4 req-5adde6cc-a8ec-4580-a216-5008b189fb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340a3a73-4163-440a-8034-ee1fcb52e1ce", "name": "network-vif-plugged", "status": "completed", "tag": "f278e67f-0609-4704-a164-6f6c20a8135e"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:32.589864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3bbbbc09-176c-495b-83f5-7b43c79e3f4f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:32.591063 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bbbbc09-176c-495b-83f5-7b43c79e3f4f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:32.591693 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bbbbc09-176c-495b-83f5-7b43c79e3f4f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:32.592224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-27e1e6be-6868-4b96-a8b5-56bf3d539fd4 req-5adde6cc-a8ec-4580-a216-5008b189fb22 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:32.592705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-27e1e6be-6868-4b96-a8b5-56bf3d539fd4 req-5adde6cc-a8ec-4580-a216-5008b189fb22 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:32.593386 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bbbbc09-176c-495b-83f5-7b43c79e3f4f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:32.594649 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bbbbc09-176c-495b-83f5-7b43c79e3f4f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:32.604234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-27e1e6be-6868-4b96-a8b5-56bf3d539fd4 req-5adde6cc-a8ec-4580-a216-5008b189fb22 service nova] Creating event network-vif-plugged:f278e67f-0609-4704-a164-6f6c20a8135e for instance 340a3a73-4163-440a-8034-ee1fcb52e1ce on hv-cinder-81045 Jun 22 17:00:32.610235 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-27e1e6be-6868-4b96-a8b5-56bf3d539fd4 req-5adde6cc-a8ec-4580-a216-5008b189fb22 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031362 Jun 22 17:00:32.611018 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 98/188] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:00:32.622501 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:32.744666 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3bbbbc09-176c-495b-83f5-7b43c79e3f4f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:32.749042 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3bbbbc09-176c-495b-83f5-7b43c79e3f4f tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.170154 Jun 22 17:00:32.749615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 91/189] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:32 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:32.822895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3103caa4-9e87-4597-824d-ef7b5564b4e2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:32.823509 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3103caa4-9e87-4597-824d-ef7b5564b4e2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:32.830851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3103caa4-9e87-4597-824d-ef7b5564b4e2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:32.831320 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3103caa4-9e87-4597-824d-ef7b5564b4e2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:32.832155 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3103caa4-9e87-4597-824d-ef7b5564b4e2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:32.832582 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3103caa4-9e87-4597-824d-ef7b5564b4e2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:32.960749 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3103caa4-9e87-4597-824d-ef7b5564b4e2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:32.968336 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3103caa4-9e87-4597-824d-ef7b5564b4e2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.149792 Jun 22 17:00:32.968903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 99/190] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:32 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:33.355267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-297992df-0e21-4f51-a007-1119f4893b35 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:33.355876 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-297992df-0e21-4f51-a007-1119f4893b35 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:33.363222 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-297992df-0e21-4f51-a007-1119f4893b35 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:33.363559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-297992df-0e21-4f51-a007-1119f4893b35 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:33.364355 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-297992df-0e21-4f51-a007-1119f4893b35 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:33.364792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-297992df-0e21-4f51-a007-1119f4893b35 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:33.493587 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-297992df-0e21-4f51-a007-1119f4893b35 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:33.501437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-297992df-0e21-4f51-a007-1119f4893b35 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.149956 Jun 22 17:00:33.501999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 92/191] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:33 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:33.766025 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5b3be490-ec55-4f88-ae34-4de5441b1c4c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:33.766620 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5b3be490-ec55-4f88-ae34-4de5441b1c4c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:33.772770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b3be490-ec55-4f88-ae34-4de5441b1c4c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:33.773216 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b3be490-ec55-4f88-ae34-4de5441b1c4c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:33.774059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b3be490-ec55-4f88-ae34-4de5441b1c4c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:33.774496 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b3be490-ec55-4f88-ae34-4de5441b1c4c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:33.903905 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5b3be490-ec55-4f88-ae34-4de5441b1c4c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:33.911190 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5b3be490-ec55-4f88-ae34-4de5441b1c4c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.149487 Jun 22 17:00:33.911746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 100/192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:33 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:33.985093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2f459f8c-346f-4091-b09a-c360d4deb29e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:33.985773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2f459f8c-346f-4091-b09a-c360d4deb29e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:33.991610 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f459f8c-346f-4091-b09a-c360d4deb29e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:33.992093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f459f8c-346f-4091-b09a-c360d4deb29e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:33.992878 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f459f8c-346f-4091-b09a-c360d4deb29e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:33.993311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f459f8c-346f-4091-b09a-c360d4deb29e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:34.128570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2f459f8c-346f-4091-b09a-c360d4deb29e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:34.138217 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2f459f8c-346f-4091-b09a-c360d4deb29e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.155242 Jun 22 17:00:34.138217 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 93/193] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:33 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:34.518888 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-75ae8a52-9493-42ca-92d6-cda08e36b7a6 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:34.519647 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-75ae8a52-9493-42ca-92d6-cda08e36b7a6 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:34.526556 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-75ae8a52-9493-42ca-92d6-cda08e36b7a6 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:34.527276 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-75ae8a52-9493-42ca-92d6-cda08e36b7a6 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:34.528414 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-75ae8a52-9493-42ca-92d6-cda08e36b7a6 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:34.528840 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-75ae8a52-9493-42ca-92d6-cda08e36b7a6 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:34.665707 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-75ae8a52-9493-42ca-92d6-cda08e36b7a6 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:34.675414 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-75ae8a52-9493-42ca-92d6-cda08e36b7a6 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1553 microversion: 2.1 time: 0.160621 Jun 22 17:00:34.675997 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 101/194] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:34 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:34.928231 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7bd61fd9-7051-499a-9707-08b7eb782929 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:34.928757 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7bd61fd9-7051-499a-9707-08b7eb782929 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:34.934720 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bd61fd9-7051-499a-9707-08b7eb782929 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:34.935167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bd61fd9-7051-499a-9707-08b7eb782929 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:34.935929 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bd61fd9-7051-499a-9707-08b7eb782929 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:34.936391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bd61fd9-7051-499a-9707-08b7eb782929 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:35.119450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7bd61fd9-7051-499a-9707-08b7eb782929 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:35.122353 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7bd61fd9-7051-499a-9707-08b7eb782929 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1314 microversion: 2.1 time: 0.198214 Jun 22 17:00:35.122918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 94/195] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:34 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:35.154247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3f923469-abee-4b0b-8928-713a614899ca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:35.154863 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3f923469-abee-4b0b-8928-713a614899ca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:35.161216 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3f923469-abee-4b0b-8928-713a614899ca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:35.161660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3f923469-abee-4b0b-8928-713a614899ca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:35.162422 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3f923469-abee-4b0b-8928-713a614899ca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:35.162853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3f923469-abee-4b0b-8928-713a614899ca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:35.166895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:35.308501 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3f923469-abee-4b0b-8928-713a614899ca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:35.316790 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3f923469-abee-4b0b-8928-713a614899ca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.167167 Jun 22 17:00:35.317931 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 102/196] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:35 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:35.365918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-22beebe6-f193-424e-8f29-88c3d3a0637c req-b3cc48ad-e76b-4225-af68-937c701718d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5342467a-6006-4ac5-91fd-573353d74fb6", "name": "network-vif-deleted", "tag": "4a282a08-7e3f-42dd-80d9-fde38e300a52"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:35.374871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-22beebe6-f193-424e-8f29-88c3d3a0637c req-b3cc48ad-e76b-4225-af68-937c701718d6 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:35.375703 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-22beebe6-f193-424e-8f29-88c3d3a0637c req-b3cc48ad-e76b-4225-af68-937c701718d6 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:35.388911 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-22beebe6-f193-424e-8f29-88c3d3a0637c req-b3cc48ad-e76b-4225-af68-937c701718d6 service nova] Creating event network-vif-deleted:4a282a08-7e3f-42dd-80d9-fde38e300a52 for instance 5342467a-6006-4ac5-91fd-573353d74fb6 on hv-cinder-81045 Jun 22 17:00:35.394397 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-22beebe6-f193-424e-8f29-88c3d3a0637c req-b3cc48ad-e76b-4225-af68-937c701718d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032947 Jun 22 17:00:35.395213 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 95/197] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:00:35.693664 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-60bd2a26-6285-4227-a8a7-14c7035a1d4f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:35.694416 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-60bd2a26-6285-4227-a8a7-14c7035a1d4f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:35.701290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60bd2a26-6285-4227-a8a7-14c7035a1d4f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:35.701868 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60bd2a26-6285-4227-a8a7-14c7035a1d4f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:35.702636 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60bd2a26-6285-4227-a8a7-14c7035a1d4f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:35.703064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-60bd2a26-6285-4227-a8a7-14c7035a1d4f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:35.776252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-60bd2a26-6285-4227-a8a7-14c7035a1d4f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:35.785140 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-60bd2a26-6285-4227-a8a7-14c7035a1d4f tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1345 microversion: 2.1 time: 0.095673 Jun 22 17:00:35.785810 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 103/198] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:35 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:36.140894 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f0cf36f0-b9d1-492b-8a4e-50e28b4fd914 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:36.140894 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f0cf36f0-b9d1-492b-8a4e-50e28b4fd914 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:36.148749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0cf36f0-b9d1-492b-8a4e-50e28b4fd914 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:36.149219 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0cf36f0-b9d1-492b-8a4e-50e28b4fd914 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:36.150040 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0cf36f0-b9d1-492b-8a4e-50e28b4fd914 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:36.150503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0cf36f0-b9d1-492b-8a4e-50e28b4fd914 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:36.309492 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f0cf36f0-b9d1-492b-8a4e-50e28b4fd914 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:36.319529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f0cf36f0-b9d1-492b-8a4e-50e28b4fd914 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1498 microversion: 2.1 time: 0.184488 Jun 22 17:00:36.321266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 96/199] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:36 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:36.339285 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fa80fec9-28a7-4b78-ac49-3de8d25584a1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:36.339890 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fa80fec9-28a7-4b78-ac49-3de8d25584a1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:36.347837 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fa80fec9-28a7-4b78-ac49-3de8d25584a1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:36.349054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fa80fec9-28a7-4b78-ac49-3de8d25584a1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:36.349984 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fa80fec9-28a7-4b78-ac49-3de8d25584a1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:36.351003 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fa80fec9-28a7-4b78-ac49-3de8d25584a1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:36.528538 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fa80fec9-28a7-4b78-ac49-3de8d25584a1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:36.536153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fa80fec9-28a7-4b78-ac49-3de8d25584a1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.205759 Jun 22 17:00:36.536713 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 104/200] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:36 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:36.802829 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:36.803435 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:36.810435 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:36.810998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:36.811754 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:36.812534 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:36.845839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:36.846282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:36.846749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lazy-loading 'fault' on Instance uuid 5342467a-6006-4ac5-91fd-573353d74fb6 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:00:36.890287 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575996511c464f37a8ab2c4369b29699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85dd6bf936e34faf84e53d142768a560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:36.898042 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7e772c5c-483c-43ba-9fc4-5e6528027177 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 200 len: 1350 microversion: 2.1 time: 0.099244 Jun 22 17:00:36.898598 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 97/201] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:36 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:37.553550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-713d7438-4be6-4c32-b877-bc1130a9b360 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:37.557089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-713d7438-4be6-4c32-b877-bc1130a9b360 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:37.561180 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-713d7438-4be6-4c32-b877-bc1130a9b360 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:37.561624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-713d7438-4be6-4c32-b877-bc1130a9b360 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:37.562382 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-713d7438-4be6-4c32-b877-bc1130a9b360 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:37.562815 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-713d7438-4be6-4c32-b877-bc1130a9b360 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:37.698165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-713d7438-4be6-4c32-b877-bc1130a9b360 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:37.708902 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-713d7438-4be6-4c32-b877-bc1130a9b360 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.158230 Jun 22 17:00:37.708902 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 105/202] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:37 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:37.916472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:37.917083 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:37.923915 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:37.924390 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:37.925211 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:37.925638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:37.940948 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] HTTP exception thrown: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Request method failure captured: Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 HTTP/1.1 Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0pRmtWsA2EJB6J03ADEt5L9lrH61Crw2WPdvydxltb2dxS9Y5bUAxDjuVDPFE9ZL0G2J9tX7d1WPkAb6aB37WOoUeZJ78WQtUqhhD2dpHEeVzaak1q3kfy8awea5Ys9tWuscLtt-fZWd9oLI5GdhnjIIfIVWQL9y5T6Cs9mRx5rj_4 Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 85dd6bf936e34faf84e53d142768a560 Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:00:37.945499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_85dd6bf936e34faf84e53d142768a560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 85dd6bf936e34faf84e53d142768a560 Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-DeleteServersTestJSON-1629840569-project Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 575996511c464f37a8ab2c4369b29699 Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-DeleteServersTestJSON-1629840569-project Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:37.946796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '5342467a-6006-4ac5-91fd-573353d74fb6'} Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:00:37.947634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:37.949002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:37.951178 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Returning 404 to user: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:00:37.952023 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-12bb4376-b666-4421-b9d0-390bc6cd982d tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 404 len: 111 microversion: 2.1 time: 0.040035 Jun 22 17:00:37.952626 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 98/203] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:37 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:00:38.062345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:38.063561 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:38.069979 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:38.070433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:38.071332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:38.071780 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:38.084733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] HTTP exception thrown: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Request method failure captured: Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6/os-volume_attachments HTTP/1.1 Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pRmtWsA2EJB6J03ADEt5L9lrH61Crw2WPdvydxltb2dxS9Y5bUAxDjuVDPFE9ZL0G2J9tX7d1WPkAb6aB37WOoUeZJ78WQtUqhhD2dpHEeVzaak1q3kfy8awea5Ys9tWuscLtt-fZWd9oLI5GdhnjIIfIVWQL9y5T6Cs9mRx5rj_4 Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 85dd6bf936e34faf84e53d142768a560 Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:00:38.089054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_85dd6bf936e34faf84e53d142768a560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 85dd6bf936e34faf84e53d142768a560 Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-DeleteServersTestJSON-1629840569-project Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 575996511c464f37a8ab2c4369b29699 Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-DeleteServersTestJSON-1629840569-project Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:38.090973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'server_id': '5342467a-6006-4ac5-91fd-573353d74fb6'} Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:00:38.091649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:38.093768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:38.095218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Returning 404 to user: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:00:38.095218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2ed72f70-53c4-4d97-913f-d200adaa9c13 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032221 Jun 22 17:00:38.095218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 106/204] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:00:38 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:00:38.120540 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-744c64fd-845c-45c8-814f-ee7a968d5d9e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:38.121036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-744c64fd-845c-45c8-814f-ee7a968d5d9e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:38.127044 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-744c64fd-845c-45c8-814f-ee7a968d5d9e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:38.127484 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-744c64fd-845c-45c8-814f-ee7a968d5d9e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:38.128279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-744c64fd-845c-45c8-814f-ee7a968d5d9e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:38.128707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-744c64fd-845c-45c8-814f-ee7a968d5d9e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:38.154669 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-744c64fd-845c-45c8-814f-ee7a968d5d9e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:00:38.485280 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-744c64fd-845c-45c8-814f-ee7a968d5d9e tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "DELETE /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 204 len: 0 microversion: 2.1 time: 0.368383 Jun 22 17:00:38.485870 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 99/205] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:00:38 2022] DELETE /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:00:38.494052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f1238a88-6948-4e2a-abce-af1a4a2bfe7c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:38.494557 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f1238a88-6948-4e2a-abce-af1a4a2bfe7c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:38.501170 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f1238a88-6948-4e2a-abce-af1a4a2bfe7c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:38.501619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f1238a88-6948-4e2a-abce-af1a4a2bfe7c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:38.502378 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f1238a88-6948-4e2a-abce-af1a4a2bfe7c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:38.502842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f1238a88-6948-4e2a-abce-af1a4a2bfe7c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:38.640249 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f1238a88-6948-4e2a-abce-af1a4a2bfe7c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:38.649274 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f1238a88-6948-4e2a-abce-af1a4a2bfe7c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1504 microversion: 2.1 time: 0.158439 Jun 22 17:00:38.649274 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 107/206] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:38 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:38.735059 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e90d1ed0-f1e2-4b2a-a95c-5a3d87b73c8a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:38.735852 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e90d1ed0-f1e2-4b2a-a95c-5a3d87b73c8a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:38.741864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e90d1ed0-f1e2-4b2a-a95c-5a3d87b73c8a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:38.742306 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e90d1ed0-f1e2-4b2a-a95c-5a3d87b73c8a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:38.743055 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e90d1ed0-f1e2-4b2a-a95c-5a3d87b73c8a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:38.743530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e90d1ed0-f1e2-4b2a-a95c-5a3d87b73c8a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:38.888807 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e90d1ed0-f1e2-4b2a-a95c-5a3d87b73c8a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:38.897406 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e90d1ed0-f1e2-4b2a-a95c-5a3d87b73c8a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.166714 Jun 22 17:00:38.908027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 100/207] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:38 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:39.500143 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:39.500687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:39.508094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:39.509016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:39.509855 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:39.510551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:39.525784 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] HTTP exception thrown: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Request method failure captured: Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: DELETE /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 HTTP/1.1 Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pRmtWsA2EJB6J03ADEt5L9lrH61Crw2WPdvydxltb2dxS9Y5bUAxDjuVDPFE9ZL0G2J9tX7d1WPkAb6aB37WOoUeZJ78WQtUqhhD2dpHEeVzaak1q3kfy8awea5Ys9tWuscLtt-fZWd9oLI5GdhnjIIfIVWQL9y5T6Cs9mRx5rj_4 Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 85dd6bf936e34faf84e53d142768a560 Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:00:39.528775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_85dd6bf936e34faf84e53d142768a560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 85dd6bf936e34faf84e53d142768a560 Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-DeleteServersTestJSON-1629840569-project Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 575996511c464f37a8ab2c4369b29699 Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-DeleteServersTestJSON-1629840569-project Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.530269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '5342467a-6006-4ac5-91fd-573353d74fb6'} Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:00:39.531088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.532721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.534487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Returning 404 to user: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:00:39.534487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f529fa1d-2b8f-410f-b73f-32f92fa0a173 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 404 len: 111 microversion: 2.1 time: 0.034020 Jun 22 17:00:39.534487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 108/208] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:00:39 2022] DELETE /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:00:39.538856 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:39.539610 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] [instance: 5342467a-6006-4ac5-91fd-573353d74fb6] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:39.546314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:39.547217 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:39.547683 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:39.548227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:39.561450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] HTTP exception thrown: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Request method failure captured: Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 HTTP/1.1 Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0pRmtWsA2EJB6J03ADEt5L9lrH61Crw2WPdvydxltb2dxS9Y5bUAxDjuVDPFE9ZL0G2J9tX7d1WPkAb6aB37WOoUeZJ78WQtUqhhD2dpHEeVzaak1q3kfy8awea5Ys9tWuscLtt-fZWd9oLI5GdhnjIIfIVWQL9y5T6Cs9mRx5rj_4 Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 85dd6bf936e34faf84e53d142768a560 Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:00:39.563067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_85dd6bf936e34faf84e53d142768a560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/85dd6bf936e34faf84e53d142768a560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 85dd6bf936e34faf84e53d142768a560 Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-DeleteServersTestJSON-1629840569 Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-DeleteServersTestJSON-1629840569-project Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 575996511c464f37a8ab2c4369b29699 Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-DeleteServersTestJSON-1629840569-project Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.564491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '5342467a-6006-4ac5-91fd-573353d74fb6'} Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:00:39.565465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. Jun 22 17:00:39.566664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:39.567633 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] Returning 404 to user: Instance 5342467a-6006-4ac5-91fd-573353d74fb6 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:00:39.567633 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b3c239c9-eff0-42ce-812d-f48f03b25200 tempest-DeleteServersTestJSON-1629840569 tempest-DeleteServersTestJSON-1629840569-project] 10.222.0.18 "GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6" status: 404 len: 111 microversion: 2.1 time: 0.029577 Jun 22 17:00:39.567633 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 101/209] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:39 2022] GET /compute/v2.1/servers/5342467a-6006-4ac5-91fd-573353d74fb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:00:39.666061 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5d1cd9b8-7502-491e-a2df-993f40eae75c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:39.667250 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5d1cd9b8-7502-491e-a2df-993f40eae75c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:39.673980 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9b8-7502-491e-a2df-993f40eae75c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:39.674611 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9b8-7502-491e-a2df-993f40eae75c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:39.676575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9b8-7502-491e-a2df-993f40eae75c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:39.676575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9b8-7502-491e-a2df-993f40eae75c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:39.845131 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5d1cd9b8-7502-491e-a2df-993f40eae75c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:39.852718 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5d1cd9b8-7502-491e-a2df-993f40eae75c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1504 microversion: 2.1 time: 0.190502 Jun 22 17:00:39.853275 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 109/210] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:39 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:39.915102 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-05a6fa55-59b5-4fce-8f78-535a8534ba0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:39.915959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-05a6fa55-59b5-4fce-8f78-535a8534ba0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:39.922234 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-05a6fa55-59b5-4fce-8f78-535a8534ba0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:39.922726 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-05a6fa55-59b5-4fce-8f78-535a8534ba0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:39.923489 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-05a6fa55-59b5-4fce-8f78-535a8534ba0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:39.923920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-05a6fa55-59b5-4fce-8f78-535a8534ba0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:40.164515 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-05a6fa55-59b5-4fce-8f78-535a8534ba0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:40.171975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-05a6fa55-59b5-4fce-8f78-535a8534ba0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.261143 Jun 22 17:00:40.172672 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 102/211] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:39 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:40.869982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-233d8362-5e50-4c22-b14e-a5931b0c3968 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:40.871201 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-233d8362-5e50-4c22-b14e-a5931b0c3968 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:40.878807 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-233d8362-5e50-4c22-b14e-a5931b0c3968 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:40.879492 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-233d8362-5e50-4c22-b14e-a5931b0c3968 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:40.880406 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-233d8362-5e50-4c22-b14e-a5931b0c3968 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:40.880935 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-233d8362-5e50-4c22-b14e-a5931b0c3968 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:41.016365 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-233d8362-5e50-4c22-b14e-a5931b0c3968 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:41.023982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-233d8362-5e50-4c22-b14e-a5931b0c3968 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1504 microversion: 2.1 time: 0.157851 Jun 22 17:00:41.024794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 110/212] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:40 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:41.189324 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2fd6d4cf-3958-4318-8605-c74e6c0980a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:41.190041 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2fd6d4cf-3958-4318-8605-c74e6c0980a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:41.200963 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2fd6d4cf-3958-4318-8605-c74e6c0980a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:41.201417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2fd6d4cf-3958-4318-8605-c74e6c0980a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:41.202274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2fd6d4cf-3958-4318-8605-c74e6c0980a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:41.202879 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2fd6d4cf-3958-4318-8605-c74e6c0980a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:41.437931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2fd6d4cf-3958-4318-8605-c74e6c0980a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:41.446057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2fd6d4cf-3958-4318-8605-c74e6c0980a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.261080 Jun 22 17:00:41.456150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 103/213] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:41 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:41.605332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-d364f0fb-3de7-4c19-b8f7-8284972183f8 req-ca9a306a-ed7c-4c5b-ba4e-560a3c05991b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340a3a73-4163-440a-8034-ee1fcb52e1ce", "name": "network-vif-deleted", "tag": "f278e67f-0609-4704-a164-6f6c20a8135e"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:41.613457 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-d364f0fb-3de7-4c19-b8f7-8284972183f8 req-ca9a306a-ed7c-4c5b-ba4e-560a3c05991b service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:41.614004 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-d364f0fb-3de7-4c19-b8f7-8284972183f8 req-ca9a306a-ed7c-4c5b-ba4e-560a3c05991b service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:41.626387 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-d364f0fb-3de7-4c19-b8f7-8284972183f8 req-ca9a306a-ed7c-4c5b-ba4e-560a3c05991b service nova] Creating event network-vif-deleted:f278e67f-0609-4704-a164-6f6c20a8135e for instance 340a3a73-4163-440a-8034-ee1fcb52e1ce on hv-cinder-81045 Jun 22 17:00:41.631405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-d364f0fb-3de7-4c19-b8f7-8284972183f8 req-ca9a306a-ed7c-4c5b-ba4e-560a3c05991b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029860 Jun 22 17:00:41.631982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 111/214] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:00:42.042526 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-460240bf-3f48-49a9-9bde-1783cc307977 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:42.047544 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-460240bf-3f48-49a9-9bde-1783cc307977 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:42.066195 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-460240bf-3f48-49a9-9bde-1783cc307977 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:42.076745 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-460240bf-3f48-49a9-9bde-1783cc307977 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:42.079564 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-460240bf-3f48-49a9-9bde-1783cc307977 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:42.082414 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-460240bf-3f48-49a9-9bde-1783cc307977 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:42.210923 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-460240bf-3f48-49a9-9bde-1783cc307977 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:42.224122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-460240bf-3f48-49a9-9bde-1783cc307977 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1299 microversion: 2.1 time: 0.184121 Jun 22 17:00:42.234924 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 104/215] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:42 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1299 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:42.464572 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fe581a3c-2cca-495d-9b12-511fb35dc240 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:42.466168 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fe581a3c-2cca-495d-9b12-511fb35dc240 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:42.485981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe581a3c-2cca-495d-9b12-511fb35dc240 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:42.486708 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe581a3c-2cca-495d-9b12-511fb35dc240 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:42.487622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe581a3c-2cca-495d-9b12-511fb35dc240 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:42.488283 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe581a3c-2cca-495d-9b12-511fb35dc240 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:42.883323 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fe581a3c-2cca-495d-9b12-511fb35dc240 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:42.918874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fe581a3c-2cca-495d-9b12-511fb35dc240 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.458877 Jun 22 17:00:42.924392 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 112/216] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:42 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:43.243844 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:43.247662 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:43.263227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:43.263445 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:43.265667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:43.266124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:43.356188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:43.356939 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:43.357546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lazy-loading 'fault' on Instance uuid 340a3a73-4163-440a-8034-ee1fcb52e1ce {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:00:43.421280 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:43.429897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8585d825-7e93-42ad-9ae9-a10a712d280c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 200 len: 1304 microversion: 2.1 time: 0.191341 Jun 22 17:00:43.430384 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 105/217] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:43 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 1304 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:43.937096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f8b9ef86-23d5-4d24-8d97-c0b0b50934be tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:43.937705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f8b9ef86-23d5-4d24-8d97-c0b0b50934be tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:43.944257 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f8b9ef86-23d5-4d24-8d97-c0b0b50934be tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:43.944712 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f8b9ef86-23d5-4d24-8d97-c0b0b50934be tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:43.945482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f8b9ef86-23d5-4d24-8d97-c0b0b50934be tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:43.945918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f8b9ef86-23d5-4d24-8d97-c0b0b50934be tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:44.099826 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f8b9ef86-23d5-4d24-8d97-c0b0b50934be tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:44.116451 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f8b9ef86-23d5-4d24-8d97-c0b0b50934be tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1521 microversion: 2.1 time: 0.182973 Jun 22 17:00:44.131026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 113/218] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:43 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:44.453176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:44.453786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: 340a3a73-4163-440a-8034-ee1fcb52e1ce] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:44.463053 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:44.464791 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:44.467169 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:44.467611 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:44.492788 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] HTTP exception thrown: Instance 340a3a73-4163-440a-8034-ee1fcb52e1ce could not be found. Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Request method failure captured: Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce HTTP/1.1 Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0qDu2bJS_8JYJAu4v1aUZ6yPqBHBvDJIorQjmP_YPdYteWhFJnk8CfDEqG3i1OUad5_qsODOhcP-_LI-ppanl3ygT7uR3DB1QRqf35knYC_0hzOfJ1GM5Qf6KlSZnbq1MYa_hPa8y6KQGhgfkuuBetyQoBB-u9-NAGmAkKowK9TSxc Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: e491322c9bb146359268dcd649f24662 Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesActionsTest-1729851509 Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:00:44.495520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e491322c9bb146359268dcd649f24662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e491322c9bb146359268dcd649f24662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e491322c9bb146359268dcd649f24662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e491322c9bb146359268dcd649f24662"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesActionsTest-1729851509 Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: e491322c9bb146359268dcd649f24662 Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesActionsTest-1729851509 Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesActionsTest-1729851509-project Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 1fe59d1f996e4abdb8a90b7444133e1c Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesActionsTest-1729851509-project Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 340a3a73-4163-440a-8034-ee1fcb52e1ce could not be found. Jun 22 17:00:44.497536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '340a3a73-4163-440a-8034-ee1fcb52e1ce'} Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340a3a73-4163-440a-8034-ee1fcb52e1ce could not be found. Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:00:44.498347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340a3a73-4163-440a-8034-ee1fcb52e1ce could not be found. Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340a3a73-4163-440a-8034-ee1fcb52e1ce could not be found. Jun 22 17:00:44.499619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:00:44.514450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Returning 404 to user: Instance 340a3a73-4163-440a-8034-ee1fcb52e1ce could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:00:44.514450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fe0a6249-1ef1-41e6-a3f6-73835be4c976 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce" status: 404 len: 111 microversion: 2.1 time: 0.049153 Jun 22 17:00:44.514450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 106/219] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:44 2022] GET /compute/v2.1/servers/340a3a73-4163-440a-8034-ee1fcb52e1ce => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:00:44.614543 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1625016436", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "networks": [{"uuid": "96204897-f870-4e58-a7fb-14aa776c9faa"}]}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:44.670271 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] validate_networks() for [('96204897-f870-4e58-a7fb-14aa776c9faa', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:00:45.142632 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2f10cfa3-685e-4660-a232-45728a574ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:45.143322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2f10cfa3-685e-4660-a232-45728a574ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:45.149347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f10cfa3-685e-4660-a232-45728a574ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:45.149802 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f10cfa3-685e-4660-a232-45728a574ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:45.150572 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f10cfa3-685e-4660-a232-45728a574ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:45.151170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f10cfa3-685e-4660-a232-45728a574ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:45.260278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:00:45.261294 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:00:45.263255 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:00:45.263802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:00:45.264255 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:00:45.294372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:45.294719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:45.298494 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:45.302158 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:45.340462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Getting quotas for project e491322c9bb146359268dcd649f24662. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:00:45.345322 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Getting quotas for user 1fe59d1f996e4abdb8a90b7444133e1c and project e491322c9bb146359268dcd649f24662. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:00:45.359706 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:00:45.362218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:00:45.395029 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2f10cfa3-685e-4660-a232-45728a574ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:45.403050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2f10cfa3-685e-4660-a232-45728a574ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1501 microversion: 2.1 time: 0.264170 Jun 22 17:00:45.416210 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 107/220] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:45 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1501 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:45.426149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-462d8a5e-8ffe-4eae-869c-40cbf729723d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:45.426774 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-462d8a5e-8ffe-4eae-869c-40cbf729723d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:45.441925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-462d8a5e-8ffe-4eae-869c-40cbf729723d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:45.442760 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-462d8a5e-8ffe-4eae-869c-40cbf729723d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:45.446325 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-462d8a5e-8ffe-4eae-869c-40cbf729723d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:45.446325 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-462d8a5e-8ffe-4eae-869c-40cbf729723d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:45.473323 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:45.564423 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-16e5325c-5e15-4037-80e7-1dce34a19425 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953731 Jun 22 17:00:45.565596 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 114/221] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:00:45.577614 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b5d7f0fe-d249-4ba0-91e8-cb4d03d2de97 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:45.585151 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b5d7f0fe-d249-4ba0-91e8-cb4d03d2de97 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:45.600094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-462d8a5e-8ffe-4eae-869c-40cbf729723d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:45.613171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-462d8a5e-8ffe-4eae-869c-40cbf729723d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1516 microversion: 2.1 time: 0.194590 Jun 22 17:00:45.614724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 108/222] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:45 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:45.655052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b5d7f0fe-d249-4ba0-91e8-cb4d03d2de97 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:45.663493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b5d7f0fe-d249-4ba0-91e8-cb4d03d2de97 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1214 microversion: 2.1 time: 0.089584 Jun 22 17:00:45.664267 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 115/223] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:45 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:46.680712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1939293c-ac01-445a-a05d-c1e1317bcaee tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:46.681310 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1939293c-ac01-445a-a05d-c1e1317bcaee tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:46.691195 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1939293c-ac01-445a-a05d-c1e1317bcaee tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:46.696925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1939293c-ac01-445a-a05d-c1e1317bcaee tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:46.696925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1939293c-ac01-445a-a05d-c1e1317bcaee tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:46.696925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1939293c-ac01-445a-a05d-c1e1317bcaee tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:46.766162 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1939293c-ac01-445a-a05d-c1e1317bcaee tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:46.777202 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1939293c-ac01-445a-a05d-c1e1317bcaee tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1218 microversion: 2.1 time: 0.100334 Jun 22 17:00:46.782945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 109/224] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:46 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:47.797548 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-632ece2a-6934-4f2c-8bb9-e17862f4dad1 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:47.800004 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-632ece2a-6934-4f2c-8bb9-e17862f4dad1 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:47.810449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-632ece2a-6934-4f2c-8bb9-e17862f4dad1 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:47.811382 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-632ece2a-6934-4f2c-8bb9-e17862f4dad1 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:47.812403 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-632ece2a-6934-4f2c-8bb9-e17862f4dad1 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:47.814160 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-632ece2a-6934-4f2c-8bb9-e17862f4dad1 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:47.916264 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-632ece2a-6934-4f2c-8bb9-e17862f4dad1 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:47.925400 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-632ece2a-6934-4f2c-8bb9-e17862f4dad1 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1274 microversion: 2.1 time: 0.132674 Jun 22 17:00:47.926397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 116/225] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:47 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:48.777240 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-adaf7bf1-4e24-4696-a465-699ac7542130 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:48.778874 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-adaf7bf1-4e24-4696-a465-699ac7542130 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:48.786229 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-adaf7bf1-4e24-4696-a465-699ac7542130 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:48.786676 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-adaf7bf1-4e24-4696-a465-699ac7542130 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:48.787439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-adaf7bf1-4e24-4696-a465-699ac7542130 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:48.787869 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-adaf7bf1-4e24-4696-a465-699ac7542130 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:48.810098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-adaf7bf1-4e24-4696-a465-699ac7542130 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lazy-loading 'flavor' on Instance uuid 72608569-4d23-4997-b09f-a8a50c5ba239 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:00:48.945065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-422bbb01-cfc5-4feb-b193-7c5f78c9aa15 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:48.946348 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-422bbb01-cfc5-4feb-b193-7c5f78c9aa15 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:48.954663 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-422bbb01-cfc5-4feb-b193-7c5f78c9aa15 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:48.955112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-422bbb01-cfc5-4feb-b193-7c5f78c9aa15 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:48.955880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-422bbb01-cfc5-4feb-b193-7c5f78c9aa15 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:48.956371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-422bbb01-cfc5-4feb-b193-7c5f78c9aa15 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:49.104023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-422bbb01-cfc5-4feb-b193-7c5f78c9aa15 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:49.112076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-422bbb01-cfc5-4feb-b193-7c5f78c9aa15 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.172027 Jun 22 17:00:49.113505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 117/226] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:48 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:49.149427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-adaf7bf1-4e24-4696-a465-699ac7542130 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239/action" status: 200 len: 32 microversion: 2.1 time: 0.376447 Jun 22 17:00:49.150027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 110/227] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:00:48 2022] POST /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 17:00:49.164067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cc37fe7a-6fd5-4dd8-95f2-4a298a6401d6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:49.165151 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-cc37fe7a-6fd5-4dd8-95f2-4a298a6401d6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:49.182453 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cc37fe7a-6fd5-4dd8-95f2-4a298a6401d6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:49.187563 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cc37fe7a-6fd5-4dd8-95f2-4a298a6401d6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:49.187563 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cc37fe7a-6fd5-4dd8-95f2-4a298a6401d6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:49.187563 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cc37fe7a-6fd5-4dd8-95f2-4a298a6401d6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:49.412812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cc37fe7a-6fd5-4dd8-95f2-4a298a6401d6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:49.425041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cc37fe7a-6fd5-4dd8-95f2-4a298a6401d6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.264689 Jun 22 17:00:49.428279 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 118/228] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:49 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:50.147559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-77fa5189-36a9-4aa1-b2e3-79272530a21d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:50.151307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-77fa5189-36a9-4aa1-b2e3-79272530a21d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:50.161618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-77fa5189-36a9-4aa1-b2e3-79272530a21d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:50.162400 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-77fa5189-36a9-4aa1-b2e3-79272530a21d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:50.163532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-77fa5189-36a9-4aa1-b2e3-79272530a21d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:50.167682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-77fa5189-36a9-4aa1-b2e3-79272530a21d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:50.435082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-77fa5189-36a9-4aa1-b2e3-79272530a21d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:50.442356 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-77fa5189-36a9-4aa1-b2e3-79272530a21d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.309275 Jun 22 17:00:50.447363 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-63816af2-65a7-496f-bc79-58e1dd1136d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:50.448982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-63816af2-65a7-496f-bc79-58e1dd1136d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:50.452493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 111/229] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:50 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:50.456366 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-63816af2-65a7-496f-bc79-58e1dd1136d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:50.456816 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-63816af2-65a7-496f-bc79-58e1dd1136d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:50.457580 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-63816af2-65a7-496f-bc79-58e1dd1136d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:50.458013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-63816af2-65a7-496f-bc79-58e1dd1136d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:50.639258 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-6d73a0fb-5b29-4751-8cab-503fe63524b4 req-f8b717fa-98cf-4a30-84ba-908e358e3e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae2ea5f-aa16-40d5-92bf-05bd9125a483", "tag": "7e7b757e-e6eb-43f5-80f0-58c515d78e08"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:50.653444 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-6d73a0fb-5b29-4751-8cab-503fe63524b4 req-f8b717fa-98cf-4a30-84ba-908e358e3e02 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:50.655232 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-6d73a0fb-5b29-4751-8cab-503fe63524b4 req-f8b717fa-98cf-4a30-84ba-908e358e3e02 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:50.672571 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-6d73a0fb-5b29-4751-8cab-503fe63524b4 req-f8b717fa-98cf-4a30-84ba-908e358e3e02 service nova] Creating event network-changed:7e7b757e-e6eb-43f5-80f0-58c515d78e08 for instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 on hv-cinder-81045 Jun 22 17:00:50.678828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-6d73a0fb-5b29-4751-8cab-503fe63524b4 req-f8b717fa-98cf-4a30-84ba-908e358e3e02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045035 Jun 22 17:00:50.684680 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 112/230] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:00:50.806976 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-63816af2-65a7-496f-bc79-58e1dd1136d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:50.815213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-63816af2-65a7-496f-bc79-58e1dd1136d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.373105 Jun 22 17:00:50.815789 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 119/231] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:50 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:51.461014 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1bf20df8-76c0-46ba-bcda-2e32a98e4132 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:51.462770 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1bf20df8-76c0-46ba-bcda-2e32a98e4132 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:51.471309 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1bf20df8-76c0-46ba-bcda-2e32a98e4132 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:51.472389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1bf20df8-76c0-46ba-bcda-2e32a98e4132 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:51.473509 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1bf20df8-76c0-46ba-bcda-2e32a98e4132 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:51.474193 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1bf20df8-76c0-46ba-bcda-2e32a98e4132 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:51.838987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-68e8cae1-6ca5-4f22-9d4c-1d390ebdc666 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:51.839691 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-68e8cae1-6ca5-4f22-9d4c-1d390ebdc666 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:51.850956 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68e8cae1-6ca5-4f22-9d4c-1d390ebdc666 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:51.851691 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68e8cae1-6ca5-4f22-9d4c-1d390ebdc666 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:51.853485 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68e8cae1-6ca5-4f22-9d4c-1d390ebdc666 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:51.854336 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68e8cae1-6ca5-4f22-9d4c-1d390ebdc666 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:52.092028 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1bf20df8-76c0-46ba-bcda-2e32a98e4132 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:52.102244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1bf20df8-76c0-46ba-bcda-2e32a98e4132 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.646004 Jun 22 17:00:52.105005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 113/232] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:51 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:52.162270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-68e8cae1-6ca5-4f22-9d4c-1d390ebdc666 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:52.184204 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-68e8cae1-6ca5-4f22-9d4c-1d390ebdc666 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.353944 Jun 22 17:00:52.184782 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 120/233] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:51 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:53.122857 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-74d2c14c-5021-4224-8922-309bcb268aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:53.124129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-74d2c14c-5021-4224-8922-309bcb268aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:53.130713 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74d2c14c-5021-4224-8922-309bcb268aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:53.132619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74d2c14c-5021-4224-8922-309bcb268aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:53.134045 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74d2c14c-5021-4224-8922-309bcb268aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:53.134713 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74d2c14c-5021-4224-8922-309bcb268aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:53.156597 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1822682627", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:53.249560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] validate_networks() for None {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:00:53.467679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-74d2c14c-5021-4224-8922-309bcb268aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:53.478161 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-74d2c14c-5021-4224-8922-309bcb268aeb tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.359641 Jun 22 17:00:53.479512 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 114/234] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:53 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:53.487467 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-825b34bf-2441-41ce-887f-9897535cd7e7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:53.488351 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-825b34bf-2441-41ce-887f-9897535cd7e7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:53.502247 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-825b34bf-2441-41ce-887f-9897535cd7e7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:53.503298 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-825b34bf-2441-41ce-887f-9897535cd7e7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:53.505828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-825b34bf-2441-41ce-887f-9897535cd7e7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:53.506449 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-825b34bf-2441-41ce-887f-9897535cd7e7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:53.726964 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:00:53.727485 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:00:53.728051 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:00:53.735745 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:00:53.735745 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:00:53.741992 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:53.742660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:53.743444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:53.744076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:53.761289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Getting quotas for project 5c1d98639af64f48966a2ba8d171895c. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:00:53.766104 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Getting quotas for user bf248c9dc99d4ee9a9fe20ef65be5c02 and project 5c1d98639af64f48966a2ba8d171895c. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:00:53.784318 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:00:53.786814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:00:53.798597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-825b34bf-2441-41ce-887f-9897535cd7e7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:53.806311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-825b34bf-2441-41ce-887f-9897535cd7e7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.325501 Jun 22 17:00:53.816847 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 115/235] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:53 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:53.944942 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-11c748ab-4ef2-4d90-bff5-7fe87cf8a907 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797755 Jun 22 17:00:53.958915 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2690d193-2371-4c1b-a66e-e2c305f98892 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:53.959749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2690d193-2371-4c1b-a66e-e2c305f98892 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:53.966098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 121/236] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 17:00:54.071164 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2690d193-2371-4c1b-a66e-e2c305f98892 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:54.078638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2690d193-2371-4c1b-a66e-e2c305f98892 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1215 microversion: 2.1 time: 0.123591 Jun 22 17:00:54.079201 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 116/237] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:53 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:54.496118 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-70b9ee57-2c64-47fb-bf44-eea6b38f3b57 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:54.496897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-70b9ee57-2c64-47fb-bf44-eea6b38f3b57 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:54.504465 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-70b9ee57-2c64-47fb-bf44-eea6b38f3b57 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:54.505212 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-70b9ee57-2c64-47fb-bf44-eea6b38f3b57 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:54.510092 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-70b9ee57-2c64-47fb-bf44-eea6b38f3b57 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:54.510092 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-70b9ee57-2c64-47fb-bf44-eea6b38f3b57 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:54.689983 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-70b9ee57-2c64-47fb-bf44-eea6b38f3b57 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:54.698696 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-70b9ee57-2c64-47fb-bf44-eea6b38f3b57 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.206711 Jun 22 17:00:54.709695 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:54 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:54.823754 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-acd4e2c8-eb26-44f2-9bf8-6463c6a898e3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:54.825534 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-acd4e2c8-eb26-44f2-9bf8-6463c6a898e3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:54.832922 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acd4e2c8-eb26-44f2-9bf8-6463c6a898e3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:54.835496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acd4e2c8-eb26-44f2-9bf8-6463c6a898e3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:54.839964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acd4e2c8-eb26-44f2-9bf8-6463c6a898e3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:54.839964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acd4e2c8-eb26-44f2-9bf8-6463c6a898e3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:55.095235 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1fe26135-012e-4ee8-bb1e-ddbe21fffe78 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:55.095852 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1fe26135-012e-4ee8-bb1e-ddbe21fffe78 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:55.162606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1fe26135-012e-4ee8-bb1e-ddbe21fffe78 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:55.184918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1fe26135-012e-4ee8-bb1e-ddbe21fffe78 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1215 microversion: 2.1 time: 0.081439 Jun 22 17:00:55.186549 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 123/239] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:55 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:55.346067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-acd4e2c8-eb26-44f2-9bf8-6463c6a898e3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:55.356015 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-acd4e2c8-eb26-44f2-9bf8-6463c6a898e3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.535928 Jun 22 17:00:55.357164 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 117/240] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:54 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:55.716521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-077cde0f-0413-449a-8328-2058d760a62d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:55.717127 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-077cde0f-0413-449a-8328-2058d760a62d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:55.723545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-077cde0f-0413-449a-8328-2058d760a62d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:55.723985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-077cde0f-0413-449a-8328-2058d760a62d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:55.724770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-077cde0f-0413-449a-8328-2058d760a62d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:55.725193 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-077cde0f-0413-449a-8328-2058d760a62d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:55.729792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:55.891787 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-077cde0f-0413-449a-8328-2058d760a62d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:55.899418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-077cde0f-0413-449a-8328-2058d760a62d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.186662 Jun 22 17:00:55.900340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 124/241] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:55 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:56.194077 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bee30e4f-978e-45e5-86b9-b8d0e4678ae8 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:56.194791 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bee30e4f-978e-45e5-86b9-b8d0e4678ae8 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:56.211941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bee30e4f-978e-45e5-86b9-b8d0e4678ae8 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:56.213737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bee30e4f-978e-45e5-86b9-b8d0e4678ae8 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:56.216054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bee30e4f-978e-45e5-86b9-b8d0e4678ae8 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:56.217140 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bee30e4f-978e-45e5-86b9-b8d0e4678ae8 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:56.305436 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bee30e4f-978e-45e5-86b9-b8d0e4678ae8 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:56.313274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bee30e4f-978e-45e5-86b9-b8d0e4678ae8 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1211 microversion: 2.1 time: 0.125364 Jun 22 17:00:56.324027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 118/242] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:56 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:56.373394 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1e7f2607-70d6-408f-8a94-15cb33efeeb6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:56.374071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1e7f2607-70d6-408f-8a94-15cb33efeeb6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:56.380194 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e7f2607-70d6-408f-8a94-15cb33efeeb6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:56.380637 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e7f2607-70d6-408f-8a94-15cb33efeeb6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:56.381406 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e7f2607-70d6-408f-8a94-15cb33efeeb6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:56.381830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e7f2607-70d6-408f-8a94-15cb33efeeb6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:56.645409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1e7f2607-70d6-408f-8a94-15cb33efeeb6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:56.662945 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1e7f2607-70d6-408f-8a94-15cb33efeeb6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.293363 Jun 22 17:00:56.669947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 125/243] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:56 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:56.923247 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fe25b3dd-28b2-4392-8011-e691a2051931 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:56.925704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fe25b3dd-28b2-4392-8011-e691a2051931 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:56.937881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe25b3dd-28b2-4392-8011-e691a2051931 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:56.940522 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe25b3dd-28b2-4392-8011-e691a2051931 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:56.941834 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe25b3dd-28b2-4392-8011-e691a2051931 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:56.944877 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe25b3dd-28b2-4392-8011-e691a2051931 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:57.247742 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fe25b3dd-28b2-4392-8011-e691a2051931 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:57.255231 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fe25b3dd-28b2-4392-8011-e691a2051931 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.340946 Jun 22 17:00:57.259676 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 119/244] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:56 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:57.332200 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-72beb9fb-9598-452d-8e90-07165ddc5a96 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:57.332823 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-72beb9fb-9598-452d-8e90-07165ddc5a96 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:57.352908 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-72beb9fb-9598-452d-8e90-07165ddc5a96 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:57.353408 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-72beb9fb-9598-452d-8e90-07165ddc5a96 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:57.356511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-72beb9fb-9598-452d-8e90-07165ddc5a96 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:57.360624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-72beb9fb-9598-452d-8e90-07165ddc5a96 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:57.504227 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-72beb9fb-9598-452d-8e90-07165ddc5a96 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:57.517884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-72beb9fb-9598-452d-8e90-07165ddc5a96 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1211 microversion: 2.1 time: 0.189160 Jun 22 17:00:57.522429 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 126/245] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:57 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:57.689437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bbc75017-fd66-4a2a-8604-4a366442edcf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:57.690297 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bbc75017-fd66-4a2a-8604-4a366442edcf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:57.701944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bbc75017-fd66-4a2a-8604-4a366442edcf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:57.704618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bbc75017-fd66-4a2a-8604-4a366442edcf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:57.708392 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bbc75017-fd66-4a2a-8604-4a366442edcf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:57.709109 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bbc75017-fd66-4a2a-8604-4a366442edcf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:58.046546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bbc75017-fd66-4a2a-8604-4a366442edcf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:58.046546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bbc75017-fd66-4a2a-8604-4a366442edcf tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.305822 Jun 22 17:00:58.046546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 120/246] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:57 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:58.127432 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-97579e28-1dc3-40a5-ae60-84611f15fd75 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'create', calling method: .version_select at 0x7fe0a0e5e1f0>, body: {"keypair": {"name": "tempest-keypair-869748818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8r7u8s+aKGHYOdPKnjHW4WWbM3ln5hGx/LrHPqvm8SKZ3mbsnyusQbbxgmP1lQ/Z2zZaW2BQmQrZckub/C5Ai2J2nfgK6l01UczSi903kSH/+2ekgGjgNZcr2NbRQhnw=="}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:58.155419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-97579e28-1dc3-40a5-ae60-84611f15fd75 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Getting quotas for project 0cdd096da8704dd3bc211b07e7f1f27e. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:00:58.159481 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-97579e28-1dc3-40a5-ae60-84611f15fd75 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Getting quotas for user 7c35fb18d4f44f26a6a0939503da0b0e and project 0cdd096da8704dd3bc211b07e7f1f27e. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:00:58.170245 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:58.282006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a5eb271d-7c00-4ff4-9696-2ad6b590853a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:58.282006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a5eb271d-7c00-4ff4-9696-2ad6b590853a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:58.296881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5eb271d-7c00-4ff4-9696-2ad6b590853a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:58.297588 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5eb271d-7c00-4ff4-9696-2ad6b590853a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:58.298552 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5eb271d-7c00-4ff4-9696-2ad6b590853a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:58.305064 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5eb271d-7c00-4ff4-9696-2ad6b590853a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:58.339926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-97579e28-1dc3-40a5-ae60-84611f15fd75 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.490956 Jun 22 17:00:58.340475 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 127/247] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:00:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:00:58.528595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a5eb271d-7c00-4ff4-9696-2ad6b590853a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:58.536494 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-50c61ed4-f5df-4ff0-a273-1d2510eb566f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:58.537451 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-50c61ed4-f5df-4ff0-a273-1d2510eb566f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:58.539178 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a5eb271d-7c00-4ff4-9696-2ad6b590853a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.267222 Jun 22 17:00:58.539762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 121/248] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:58 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:58.547418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-50c61ed4-f5df-4ff0-a273-1d2510eb566f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:58.548576 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-50c61ed4-f5df-4ff0-a273-1d2510eb566f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:58.549605 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-50c61ed4-f5df-4ff0-a273-1d2510eb566f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:58.550298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-50c61ed4-f5df-4ff0-a273-1d2510eb566f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:58.629319 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-50c61ed4-f5df-4ff0-a273-1d2510eb566f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:58.640324 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-50c61ed4-f5df-4ff0-a273-1d2510eb566f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1267 microversion: 2.1 time: 0.108031 Jun 22 17:00:58.655326 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 128/249] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:58 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:58.849811 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-ffcf3af8-648b-4f06-b8ac-532d3df5a362 req-238408aa-e4c6-4d01-a891-31565d63a438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae2ea5f-aa16-40d5-92bf-05bd9125a483", "name": "network-vif-plugged", "status": "completed", "tag": "7e7b757e-e6eb-43f5-80f0-58c515d78e08"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:00:58.864289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ffcf3af8-648b-4f06-b8ac-532d3df5a362 req-238408aa-e4c6-4d01-a891-31565d63a438 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:58.880015 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ffcf3af8-648b-4f06-b8ac-532d3df5a362 req-238408aa-e4c6-4d01-a891-31565d63a438 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:58.904854 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-ffcf3af8-648b-4f06-b8ac-532d3df5a362 req-238408aa-e4c6-4d01-a891-31565d63a438 service nova] Creating event network-vif-plugged:7e7b757e-e6eb-43f5-80f0-58c515d78e08 for instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 on hv-cinder-81045 Jun 22 17:00:58.916027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-ffcf3af8-648b-4f06-b8ac-532d3df5a362 req-238408aa-e4c6-4d01-a891-31565d63a438 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070495 Jun 22 17:00:58.917663 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 122/250] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:00:59.052140 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-aa38556d-508b-41b6-b0b0-d4f30d2c1da1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:59.052687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-aa38556d-508b-41b6-b0b0-d4f30d2c1da1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:59.083354 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aa38556d-508b-41b6-b0b0-d4f30d2c1da1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:59.085309 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aa38556d-508b-41b6-b0b0-d4f30d2c1da1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:59.088294 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aa38556d-508b-41b6-b0b0-d4f30d2c1da1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:59.090397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aa38556d-508b-41b6-b0b0-d4f30d2c1da1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:59.370088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-aa38556d-508b-41b6-b0b0-d4f30d2c1da1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:59.379048 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-aa38556d-508b-41b6-b0b0-d4f30d2c1da1 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.330847 Jun 22 17:00:59.379617 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 129/251] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:59 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:00:59.562005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9c205c21-dcfb-4cc2-92cc-8500e236e4cf tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:59.562005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9c205c21-dcfb-4cc2-92cc-8500e236e4cf tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:59.566778 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c205c21-dcfb-4cc2-92cc-8500e236e4cf tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:59.567244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c205c21-dcfb-4cc2-92cc-8500e236e4cf tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:59.568048 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c205c21-dcfb-4cc2-92cc-8500e236e4cf tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:59.568469 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c205c21-dcfb-4cc2-92cc-8500e236e4cf tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:59.661142 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d680f0db-5b6d-4374-a08b-ca4ba518c07f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:00:59.662029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d680f0db-5b6d-4374-a08b-ca4ba518c07f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:00:59.674338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d680f0db-5b6d-4374-a08b-ca4ba518c07f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:59.674991 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d680f0db-5b6d-4374-a08b-ca4ba518c07f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:59.675920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d680f0db-5b6d-4374-a08b-ca4ba518c07f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:00:59.676547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d680f0db-5b6d-4374-a08b-ca4ba518c07f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:00:59.813580 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d680f0db-5b6d-4374-a08b-ca4ba518c07f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:59.824369 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d680f0db-5b6d-4374-a08b-ca4ba518c07f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1273 microversion: 2.1 time: 0.169874 Jun 22 17:00:59.825003 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 130/252] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:59 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:00:59.911006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9c205c21-dcfb-4cc2-92cc-8500e236e4cf tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:00:59.920748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9c205c21-dcfb-4cc2-92cc-8500e236e4cf tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.366271 Jun 22 17:00:59.921481 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 123/253] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:00:59 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:00.396333 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8ec11603-8c0b-4243-b7b7-8bf3d58732bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:00.397670 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8ec11603-8c0b-4243-b7b7-8bf3d58732bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:00.404056 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ec11603-8c0b-4243-b7b7-8bf3d58732bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:00.409460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ec11603-8c0b-4243-b7b7-8bf3d58732bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:00.409460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ec11603-8c0b-4243-b7b7-8bf3d58732bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:00.409460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ec11603-8c0b-4243-b7b7-8bf3d58732bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:00.841439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bd1c1d11-41b1-4208-94d6-98acc0517459 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:00.842406 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bd1c1d11-41b1-4208-94d6-98acc0517459 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:00.860598 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd1c1d11-41b1-4208-94d6-98acc0517459 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:00.865094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd1c1d11-41b1-4208-94d6-98acc0517459 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:00.866639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd1c1d11-41b1-4208-94d6-98acc0517459 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:00.868913 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd1c1d11-41b1-4208-94d6-98acc0517459 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:00.915809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8ec11603-8c0b-4243-b7b7-8bf3d58732bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:00.925108 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8ec11603-8c0b-4243-b7b7-8bf3d58732bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1502 microversion: 2.1 time: 0.532629 Jun 22 17:01:00.925690 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 131/254] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:00 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1502 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:00.938282 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ff8208d8-b47d-4ca0-8609-be58faa8814d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:00.938893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ff8208d8-b47d-4ca0-8609-be58faa8814d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:00.950830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff8208d8-b47d-4ca0-8609-be58faa8814d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:00.951703 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff8208d8-b47d-4ca0-8609-be58faa8814d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:00.952697 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff8208d8-b47d-4ca0-8609-be58faa8814d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:00.953279 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff8208d8-b47d-4ca0-8609-be58faa8814d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:01.017142 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bd1c1d11-41b1-4208-94d6-98acc0517459 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:01.029675 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bd1c1d11-41b1-4208-94d6-98acc0517459 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1273 microversion: 2.1 time: 0.192242 Jun 22 17:01:01.031992 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 124/255] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:00 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:01.049162 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38d1f695-a1e3-4826-a03e-af80c73552b5"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:01.050293 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:01.056780 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:01.057459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:01.058419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:01.059144 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:01.092741 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:01.097858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] HTTP exception thrown: Cannot 'attach_volume' instance 72608569-4d23-4997-b09f-a8a50c5ba239 while it is in vm_state rescued Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Request method failure captured: Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: POST /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239/os-volume_attachments HTTP/1.1 Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 74 Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0pRX08G0hDAHdLZrPBdOY8xLt6MLOfbdxcPdnme58g8-lvFRI7YFKpc3vw_491ML24LRnxReqb6g0LlTuMBL3nYFv0dP7LJfMpJIU77xspWSTdgdRGywdQNuMO8vL9o2Jynur21dIF6ucwSjsG5goigxgPFKASXjuvCPLvgveP2-TY Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:01:01.101380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 276147f205ae43da9df678dcd572115a Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {"volumeAttachment": {"volumeId": "38d1f695-a1e3-4826-a03e-af80c73552b5"}} Jun 22 17:01:01.102640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Cannot 'attach_volume' instance 72608569-4d23-4997-b09f-a8a50c5ba239 while it is in vm_state rescued Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'server_id': '72608569-4d23-4997-b09f-a8a50c5ba239', 'body': {'volumeAttachment': {'volumeId': '38d1f695-a1e3-4826-a03e-af80c73552b5'}}} Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72608569-4d23-4997-b09f-a8a50c5ba239 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:01:01.103438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 72608569-4d23-4997-b09f-a8a50c5ba239 while it is in vm_state rescued Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:01:01.105715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:01:01.112916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:01:01.112916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:01:01.112916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 72608569-4d23-4997-b09f-a8a50c5ba239 while it is in vm_state rescued Jun 22 17:01:01.112916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:01.112916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Returning 409 to user: Cannot 'attach_volume' instance 72608569-4d23-4997-b09f-a8a50c5ba239 while it is in vm_state rescued {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:01:01.112916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-21ba5184-1164-4943-978e-d788cd783495 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074772 Jun 22 17:01:01.112916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 125/256] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:01:01 2022] POST /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 17:01:01.117173 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f5138363-d811-4811-8214-81de75cf4366 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:01.117714 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f5138363-d811-4811-8214-81de75cf4366 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:01.125744 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5138363-d811-4811-8214-81de75cf4366 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:01.126207 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5138363-d811-4811-8214-81de75cf4366 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:01.129316 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5138363-d811-4811-8214-81de75cf4366 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:01.129316 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5138363-d811-4811-8214-81de75cf4366 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:01.221924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ff8208d8-b47d-4ca0-8609-be58faa8814d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:01.232361 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ff8208d8-b47d-4ca0-8609-be58faa8814d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1314 microversion: 2.1 time: 0.298395 Jun 22 17:01:01.235827 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 132/257] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:00 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:01.364095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f5138363-d811-4811-8214-81de75cf4366 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239/action" status: 202 len: 0 microversion: 2.1 time: 0.250897 Jun 22 17:01:01.364732 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 126/258] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:01:01 2022] POST /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:01:01.373652 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a8712c14-0eae-4e71-87cc-effd9a1e3b50 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:01.374834 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a8712c14-0eae-4e71-87cc-effd9a1e3b50 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:01.383095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8712c14-0eae-4e71-87cc-effd9a1e3b50 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:01.383973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8712c14-0eae-4e71-87cc-effd9a1e3b50 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:01.385310 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8712c14-0eae-4e71-87cc-effd9a1e3b50 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:01.386393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8712c14-0eae-4e71-87cc-effd9a1e3b50 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:01.747569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a8712c14-0eae-4e71-87cc-effd9a1e3b50 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:01.757441 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a8712c14-0eae-4e71-87cc-effd9a1e3b50 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1510 microversion: 2.1 time: 0.388396 Jun 22 17:01:01.759365 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 133/259] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:01 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:02.051736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e4c74ab6-19da-45d0-b2d8-d05ed03d96d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:02.053191 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e4c74ab6-19da-45d0-b2d8-d05ed03d96d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:02.085374 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4c74ab6-19da-45d0-b2d8-d05ed03d96d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:02.086081 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4c74ab6-19da-45d0-b2d8-d05ed03d96d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:02.087862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4c74ab6-19da-45d0-b2d8-d05ed03d96d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:02.089648 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4c74ab6-19da-45d0-b2d8-d05ed03d96d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:02.248746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-783bc8b8-cf26-4742-9ff9-5ccb754ada8d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:02.249363 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-783bc8b8-cf26-4742-9ff9-5ccb754ada8d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:02.278554 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-783bc8b8-cf26-4742-9ff9-5ccb754ada8d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:02.282571 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-783bc8b8-cf26-4742-9ff9-5ccb754ada8d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:02.285275 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-783bc8b8-cf26-4742-9ff9-5ccb754ada8d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:02.287153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-783bc8b8-cf26-4742-9ff9-5ccb754ada8d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:02.423726 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e4c74ab6-19da-45d0-b2d8-d05ed03d96d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:02.432879 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e4c74ab6-19da-45d0-b2d8-d05ed03d96d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.385297 Jun 22 17:01:02.435170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 127/260] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:02 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:02.563065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-783bc8b8-cf26-4742-9ff9-5ccb754ada8d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:02.580922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-783bc8b8-cf26-4742-9ff9-5ccb754ada8d tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1498 microversion: 2.1 time: 0.336088 Jun 22 17:01:02.581498 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 134/261] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:02 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1498 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:02.780860 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e1ac3972-7a7f-4eab-a287-09dd146afad2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:02.786712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e1ac3972-7a7f-4eab-a287-09dd146afad2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:02.786712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:02.788695 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1ac3972-7a7f-4eab-a287-09dd146afad2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:02.789148 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1ac3972-7a7f-4eab-a287-09dd146afad2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:02.789920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1ac3972-7a7f-4eab-a287-09dd146afad2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:02.790357 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1ac3972-7a7f-4eab-a287-09dd146afad2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:02.925471 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1084962420", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99c8c400-1daa-4f6f-b0dc-9ff6aced9b85"}], "security_groups": [{"name": "tempest-securitygroup--715042192"}], "key_name": "tempest-keypair-869748818", "user_data": "}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:03.105565 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e1ac3972-7a7f-4eab-a287-09dd146afad2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:03.114072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e1ac3972-7a7f-4eab-a287-09dd146afad2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1510 microversion: 2.1 time: 0.341840 Jun 22 17:01:03.115148 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 128/262] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:02 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:03.124663 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] validate_networks() for [('99c8c400-1daa-4f6f-b0dc-9ff6aced9b85', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:01:03.452375 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1e6a468d-a127-40d7-85d3-2320a43a53f1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:03.453120 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1e6a468d-a127-40d7-85d3-2320a43a53f1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:03.467045 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e6a468d-a127-40d7-85d3-2320a43a53f1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:03.467495 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e6a468d-a127-40d7-85d3-2320a43a53f1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:03.474641 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e6a468d-a127-40d7-85d3-2320a43a53f1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:03.475411 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e6a468d-a127-40d7-85d3-2320a43a53f1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:03.646244 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:01:03.646736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:01:03.647281 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:01:03.647816 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:01:03.648466 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:01:03.662759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:03.663732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:03.664886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:03.665556 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:03.681518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1e6a468d-a127-40d7-85d3-2320a43a53f1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:03.689569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Getting quotas for project 0cdd096da8704dd3bc211b07e7f1f27e. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:01:03.694477 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Getting quotas for user 7c35fb18d4f44f26a6a0939503da0b0e and project 0cdd096da8704dd3bc211b07e7f1f27e. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:01:03.695293 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1e6a468d-a127-40d7-85d3-2320a43a53f1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.248311 Jun 22 17:01:03.696567 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 129/263] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:03 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:03.740640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-1363ab2f-55e0-4f9f-b82c-60b25f712519 req-000b45e7-9c82-4545-a953-f215ad0905b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7", "tag": "e61ff2d2-caee-48ec-9f7f-99f64a4cfeaf"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:03.767076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1363ab2f-55e0-4f9f-b82c-60b25f712519 req-000b45e7-9c82-4545-a953-f215ad0905b8 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:03.767528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1363ab2f-55e0-4f9f-b82c-60b25f712519 req-000b45e7-9c82-4545-a953-f215ad0905b8 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:03.777061 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:01:03.792588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:01:03.810896 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-1363ab2f-55e0-4f9f-b82c-60b25f712519 req-000b45e7-9c82-4545-a953-f215ad0905b8 service nova] Creating event network-changed:e61ff2d2-caee-48ec-9f7f-99f64a4cfeaf for instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 on hv-cinder-81045 Jun 22 17:01:03.817732 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-1363ab2f-55e0-4f9f-b82c-60b25f712519 req-000b45e7-9c82-4545-a953-f215ad0905b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083791 Jun 22 17:01:03.819056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 130/264] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:01:03.991388 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-06379b1f-78ef-4d75-8495-269c4901a4a4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.070826 Jun 22 17:01:03.992452 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 135/265] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:01:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 17:01:04.028082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-79e266ed-3223-41b6-a7d3-0493cfbfb161 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:04.028828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-79e266ed-3223-41b6-a7d3-0493cfbfb161 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:04.080952 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:04.107128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-79e266ed-3223-41b6-a7d3-0493cfbfb161 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:04.114971 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-79e266ed-3223-41b6-a7d3-0493cfbfb161 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1237 microversion: 2.1 time: 0.115568 Jun 22 17:01:04.117732 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 131/266] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:03 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:04.134545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5b3d2fdc-9ade-45cd-9c8b-6d5339e19c34 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:04.135159 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5b3d2fdc-9ade-45cd-9c8b-6d5339e19c34 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:04.142151 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b3d2fdc-9ade-45cd-9c8b-6d5339e19c34 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:04.142606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b3d2fdc-9ade-45cd-9c8b-6d5339e19c34 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:04.143372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b3d2fdc-9ade-45cd-9c8b-6d5339e19c34 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:04.143815 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b3d2fdc-9ade-45cd-9c8b-6d5339e19c34 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:04.279211 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5b3d2fdc-9ade-45cd-9c8b-6d5339e19c34 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:04.286863 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5b3d2fdc-9ade-45cd-9c8b-6d5339e19c34 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1510 microversion: 2.1 time: 0.157003 Jun 22 17:01:04.287418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 136/267] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:04 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:04.475489 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-078982ea-1357-4f9e-9f91-3ab06602b961 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:04.475985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-078982ea-1357-4f9e-9f91-3ab06602b961 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:04.482951 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-078982ea-1357-4f9e-9f91-3ab06602b961 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:04.486976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-078982ea-1357-4f9e-9f91-3ab06602b961 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:04.486976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-078982ea-1357-4f9e-9f91-3ab06602b961 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:04.486976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-078982ea-1357-4f9e-9f91-3ab06602b961 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:04.510842 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-078982ea-1357-4f9e-9f91-3ab06602b961 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:01:04.715392 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-02246360-92e4-419a-bcb6-fd66fa066d94 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:04.716189 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-02246360-92e4-419a-bcb6-fd66fa066d94 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:04.722544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02246360-92e4-419a-bcb6-fd66fa066d94 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:04.723059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02246360-92e4-419a-bcb6-fd66fa066d94 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:04.724169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02246360-92e4-419a-bcb6-fd66fa066d94 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:04.724690 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02246360-92e4-419a-bcb6-fd66fa066d94 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:04.850264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-078982ea-1357-4f9e-9f91-3ab06602b961 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 204 len: 0 microversion: 2.1 time: 0.378193 Jun 22 17:01:04.851350 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 132/268] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:01:04 2022] DELETE /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:01:04.860579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-af1c1b25-adac-4001-b039-47d5d20864fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:04.861274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-af1c1b25-adac-4001-b039-47d5d20864fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:04.873515 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-af1c1b25-adac-4001-b039-47d5d20864fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:04.873967 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-af1c1b25-adac-4001-b039-47d5d20864fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:04.874738 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-af1c1b25-adac-4001-b039-47d5d20864fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:04.875164 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-af1c1b25-adac-4001-b039-47d5d20864fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:04.915294 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-02246360-92e4-419a-bcb6-fd66fa066d94 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:04.925048 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-02246360-92e4-419a-bcb6-fd66fa066d94 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.214045 Jun 22 17:01:04.926077 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 137/269] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:04 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:05.044751 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-af1c1b25-adac-4001-b039-47d5d20864fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:05.053718 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-af1c1b25-adac-4001-b039-47d5d20864fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1504 microversion: 2.1 time: 0.198027 Jun 22 17:01:05.054431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 133/270] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:04 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:05.134091 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7f0fc75e-846d-4359-9d37-3a916e1c50f0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:05.134734 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7f0fc75e-846d-4359-9d37-3a916e1c50f0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:05.193112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7f0fc75e-846d-4359-9d37-3a916e1c50f0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:05.201008 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7f0fc75e-846d-4359-9d37-3a916e1c50f0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1237 microversion: 2.1 time: 0.070555 Jun 22 17:01:05.201770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 138/271] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:05 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:05.304330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f7b8fcd6-a396-49b8-8883-794a1d2f86d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:05.304942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f7b8fcd6-a396-49b8-8883-794a1d2f86d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:05.312207 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f7b8fcd6-a396-49b8-8883-794a1d2f86d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:05.312900 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f7b8fcd6-a396-49b8-8883-794a1d2f86d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:05.313828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f7b8fcd6-a396-49b8-8883-794a1d2f86d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:05.314415 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f7b8fcd6-a396-49b8-8883-794a1d2f86d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:05.482776 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f7b8fcd6-a396-49b8-8883-794a1d2f86d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:05.490367 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f7b8fcd6-a396-49b8-8883-794a1d2f86d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1510 microversion: 2.1 time: 0.190170 Jun 22 17:01:05.490855 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 134/272] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:05 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:05.942394 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8894fc2e-0229-46c0-aa68-dfc4554b7ada tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:05.943083 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8894fc2e-0229-46c0-aa68-dfc4554b7ada tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:05.949848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8894fc2e-0229-46c0-aa68-dfc4554b7ada tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:05.950787 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8894fc2e-0229-46c0-aa68-dfc4554b7ada tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:05.951541 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8894fc2e-0229-46c0-aa68-dfc4554b7ada tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:05.951968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8894fc2e-0229-46c0-aa68-dfc4554b7ada tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:06.070811 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-23287c3d-6a20-40a8-acef-39c50edbc086 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:06.071527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-23287c3d-6a20-40a8-acef-39c50edbc086 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:06.078205 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-23287c3d-6a20-40a8-acef-39c50edbc086 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:06.078750 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-23287c3d-6a20-40a8-acef-39c50edbc086 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:06.079502 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-23287c3d-6a20-40a8-acef-39c50edbc086 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:06.079929 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-23287c3d-6a20-40a8-acef-39c50edbc086 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:06.085825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8894fc2e-0229-46c0-aa68-dfc4554b7ada tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:06.092254 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8894fc2e-0229-46c0-aa68-dfc4554b7ada tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.153742 Jun 22 17:01:06.092823 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 139/273] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:05 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:06.210472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-23287c3d-6a20-40a8-acef-39c50edbc086 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:06.218080 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2c0e0691-1bfe-4877-814d-13f8385f1fb6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:06.218849 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-23287c3d-6a20-40a8-acef-39c50edbc086 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1504 microversion: 2.1 time: 0.151875 Jun 22 17:01:06.219408 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 135/274] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:06 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:06.219524 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2c0e0691-1bfe-4877-814d-13f8385f1fb6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:06.232438 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c0e0691-1bfe-4877-814d-13f8385f1fb6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:06.232955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c0e0691-1bfe-4877-814d-13f8385f1fb6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:06.233783 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c0e0691-1bfe-4877-814d-13f8385f1fb6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:06.234213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c0e0691-1bfe-4877-814d-13f8385f1fb6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:06.314937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2c0e0691-1bfe-4877-814d-13f8385f1fb6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:06.323087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2c0e0691-1bfe-4877-814d-13f8385f1fb6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1241 microversion: 2.1 time: 0.109442 Jun 22 17:01:06.323661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 140/275] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:06 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:06.507915 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8ab805f4-4685-48bc-a095-013fec01ec8b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:06.508584 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8ab805f4-4685-48bc-a095-013fec01ec8b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:06.515035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8ab805f4-4685-48bc-a095-013fec01ec8b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:06.515482 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8ab805f4-4685-48bc-a095-013fec01ec8b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:06.516276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8ab805f4-4685-48bc-a095-013fec01ec8b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:06.516707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8ab805f4-4685-48bc-a095-013fec01ec8b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:06.658906 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8ab805f4-4685-48bc-a095-013fec01ec8b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:06.665817 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8ab805f4-4685-48bc-a095-013fec01ec8b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1510 microversion: 2.1 time: 0.161712 Jun 22 17:01:06.666482 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 136/276] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:06 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:07.109521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-10b397d5-5554-4068-b5f7-c3c0fcf7e92d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:07.110135 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-10b397d5-5554-4068-b5f7-c3c0fcf7e92d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:07.116156 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-10b397d5-5554-4068-b5f7-c3c0fcf7e92d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:07.116613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-10b397d5-5554-4068-b5f7-c3c0fcf7e92d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:07.117395 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-10b397d5-5554-4068-b5f7-c3c0fcf7e92d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:07.117813 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-10b397d5-5554-4068-b5f7-c3c0fcf7e92d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:07.237341 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-135adf37-3640-40bc-acaa-10ca56e3f5fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:07.238315 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-135adf37-3640-40bc-acaa-10ca56e3f5fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:07.245696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-135adf37-3640-40bc-acaa-10ca56e3f5fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:07.246145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-135adf37-3640-40bc-acaa-10ca56e3f5fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:07.247110 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-135adf37-3640-40bc-acaa-10ca56e3f5fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:07.247792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-135adf37-3640-40bc-acaa-10ca56e3f5fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:07.264698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-10b397d5-5554-4068-b5f7-c3c0fcf7e92d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:07.276693 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-10b397d5-5554-4068-b5f7-c3c0fcf7e92d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.171429 Jun 22 17:01:07.281898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 141/277] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:07 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:07.354031 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0f1e0f82-4e80-4891-9e4f-2f789699290d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:07.354031 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0f1e0f82-4e80-4891-9e4f-2f789699290d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:07.358139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0f1e0f82-4e80-4891-9e4f-2f789699290d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:07.358554 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0f1e0f82-4e80-4891-9e4f-2f789699290d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:07.359365 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0f1e0f82-4e80-4891-9e4f-2f789699290d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:07.359798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0f1e0f82-4e80-4891-9e4f-2f789699290d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:07.421221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-135adf37-3640-40bc-acaa-10ca56e3f5fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:07.440983 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0f1e0f82-4e80-4891-9e4f-2f789699290d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:07.453062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-135adf37-3640-40bc-acaa-10ca56e3f5fe tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1504 microversion: 2.1 time: 0.218175 Jun 22 17:01:07.460251 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 137/278] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:07 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:07.460524 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0f1e0f82-4e80-4891-9e4f-2f789699290d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1233 microversion: 2.1 time: 0.122488 Jun 22 17:01:07.465320 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 142/279] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:07 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1233 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:07.688891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4c747c51-5f9f-46d4-9a52-128eb2ced58e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:07.689767 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4c747c51-5f9f-46d4-9a52-128eb2ced58e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:07.697701 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4c747c51-5f9f-46d4-9a52-128eb2ced58e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:07.698698 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4c747c51-5f9f-46d4-9a52-128eb2ced58e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:07.699671 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4c747c51-5f9f-46d4-9a52-128eb2ced58e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:07.702218 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4c747c51-5f9f-46d4-9a52-128eb2ced58e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:08.036758 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4c747c51-5f9f-46d4-9a52-128eb2ced58e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:08.044232 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4c747c51-5f9f-46d4-9a52-128eb2ced58e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1516 microversion: 2.1 time: 0.362762 Jun 22 17:01:08.045493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 138/280] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:07 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:08.299080 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e1a03f73-5a41-4b92-9404-479daaa0f905 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:08.299797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e1a03f73-5a41-4b92-9404-479daaa0f905 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:08.314685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e1a03f73-5a41-4b92-9404-479daaa0f905 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:08.314685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e1a03f73-5a41-4b92-9404-479daaa0f905 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:08.314685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e1a03f73-5a41-4b92-9404-479daaa0f905 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:08.314685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e1a03f73-5a41-4b92-9404-479daaa0f905 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:08.332290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:08.456801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e1a03f73-5a41-4b92-9404-479daaa0f905 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:08.471530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-22d4d127-9f59-4ea0-965b-68157054cc8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:08.472952 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-22d4d127-9f59-4ea0-965b-68157054cc8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:08.479666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e1a03f73-5a41-4b92-9404-479daaa0f905 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.184575 Jun 22 17:01:08.482102 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 143/281] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:08 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:08.489391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-22d4d127-9f59-4ea0-965b-68157054cc8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:08.490036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-22d4d127-9f59-4ea0-965b-68157054cc8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:08.490981 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-22d4d127-9f59-4ea0-965b-68157054cc8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:08.491565 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-22d4d127-9f59-4ea0-965b-68157054cc8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:08.493923 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d1ccc0ed-081f-4650-bc76-92540c320a81 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:08.497770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d1ccc0ed-081f-4650-bc76-92540c320a81 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:08.509546 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0ed-081f-4650-bc76-92540c320a81 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:08.510322 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0ed-081f-4650-bc76-92540c320a81 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:08.511112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0ed-081f-4650-bc76-92540c320a81 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:08.511553 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0ed-081f-4650-bc76-92540c320a81 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:08.576040 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-22d4d127-9f59-4ea0-965b-68157054cc8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:08.581581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d1ccc0ed-081f-4650-bc76-92540c320a81 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:08.584220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-22d4d127-9f59-4ea0-965b-68157054cc8c tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1462 microversion: 2.1 time: 0.117234 Jun 22 17:01:08.584801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 139/282] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:08 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1462 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:08.589264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-2888332b-30eb-415e-8687-96eef55146a8 req-f1e04516-2d7e-44be-ab67-5e229bc04280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae2ea5f-aa16-40d5-92bf-05bd9125a483", "name": "network-vif-deleted", "tag": "7e7b757e-e6eb-43f5-80f0-58c515d78e08"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:08.589855 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d1ccc0ed-081f-4650-bc76-92540c320a81 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1297 microversion: 2.1 time: 0.105055 Jun 22 17:01:08.590487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 144/283] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:08 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:08.600290 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2888332b-30eb-415e-8687-96eef55146a8 req-f1e04516-2d7e-44be-ab67-5e229bc04280 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:08.600290 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2888332b-30eb-415e-8687-96eef55146a8 req-f1e04516-2d7e-44be-ab67-5e229bc04280 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:08.610771 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-2888332b-30eb-415e-8687-96eef55146a8 req-f1e04516-2d7e-44be-ab67-5e229bc04280 service nova] Creating event network-vif-deleted:7e7b757e-e6eb-43f5-80f0-58c515d78e08 for instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 on hv-cinder-81045 Jun 22 17:01:08.615679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-2888332b-30eb-415e-8687-96eef55146a8 req-f1e04516-2d7e-44be-ab67-5e229bc04280 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029773 Jun 22 17:01:08.616328 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 140/284] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:09.499327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1086d8be-ece3-4562-bc02-1f7971ce320d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:09.499934 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1086d8be-ece3-4562-bc02-1f7971ce320d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:09.507765 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1086d8be-ece3-4562-bc02-1f7971ce320d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:09.508452 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1086d8be-ece3-4562-bc02-1f7971ce320d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:09.509945 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1086d8be-ece3-4562-bc02-1f7971ce320d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:09.511005 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1086d8be-ece3-4562-bc02-1f7971ce320d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:09.602207 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c292dad6-cf73-46e1-82f2-a60fa85fa08a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:09.602908 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c292dad6-cf73-46e1-82f2-a60fa85fa08a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:09.614048 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c292dad6-cf73-46e1-82f2-a60fa85fa08a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:09.614873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c292dad6-cf73-46e1-82f2-a60fa85fa08a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:09.615924 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c292dad6-cf73-46e1-82f2-a60fa85fa08a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:09.616531 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c292dad6-cf73-46e1-82f2-a60fa85fa08a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:09.676395 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1086d8be-ece3-4562-bc02-1f7971ce320d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:09.684796 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1086d8be-ece3-4562-bc02-1f7971ce320d tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.189742 Jun 22 17:01:09.686556 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c292dad6-cf73-46e1-82f2-a60fa85fa08a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:09.687240 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 145/285] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:09 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:09.692823 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-29c3560a-6cfb-410d-a1f3-6f66836c294c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:09.693812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-29c3560a-6cfb-410d-a1f3-6f66836c294c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:09.697995 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c292dad6-cf73-46e1-82f2-a60fa85fa08a tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1462 microversion: 2.1 time: 0.098856 Jun 22 17:01:09.697995 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 141/286] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:09 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:09.710485 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-29c3560a-6cfb-410d-a1f3-6f66836c294c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:09.710963 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-29c3560a-6cfb-410d-a1f3-6f66836c294c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:09.711727 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-29c3560a-6cfb-410d-a1f3-6f66836c294c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:09.712353 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-29c3560a-6cfb-410d-a1f3-6f66836c294c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:09.776570 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-29c3560a-6cfb-410d-a1f3-6f66836c294c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:09.785549 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-29c3560a-6cfb-410d-a1f3-6f66836c294c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1297 microversion: 2.1 time: 0.097194 Jun 22 17:01:09.786108 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 146/287] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:09 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:09.899537 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6a523c93-7a2b-4e66-9123-6d5b944eea9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'create', calling method: .version_select at 0x7fe0a0eb1af0>, body: {"keypair": {"name": "tempest-keypair-1652442716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaUNGi840PDXkO0RF5yOwQx5JRv2kRkbwp5hsCvfKUYKxnxelBK92YrUZg3d5xBIieytBeSLdjPWZ7UvqSOrqtbSo+AgQ4rL7ND3JWNhWadvHe3jPug1s8n4fy0+9tE7g=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:09.920567 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-6a523c93-7a2b-4e66-9123-6d5b944eea9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Getting quotas for project 47bd5d8cddc94945b967b114d49f086c. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:01:09.924349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-6a523c93-7a2b-4e66-9123-6d5b944eea9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Getting quotas for user 276147f205ae43da9df678dcd572115a and project 47bd5d8cddc94945b967b114d49f086c. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:01:10.072056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6a523c93-7a2b-4e66-9123-6d5b944eea9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176283 Jun 22 17:01:10.076179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 142/288] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:01:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:10.705468 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-168cac8b-b868-4bd1-a2dc-a207f9ff4825 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:10.706081 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-168cac8b-b868-4bd1-a2dc-a207f9ff4825 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:10.714835 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:10.715457 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:10.726918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:10.728858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-168cac8b-b868-4bd1-a2dc-a207f9ff4825 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:10.729311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-168cac8b-b868-4bd1-a2dc-a207f9ff4825 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:10.730089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-168cac8b-b868-4bd1-a2dc-a207f9ff4825 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:10.730527 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-168cac8b-b868-4bd1-a2dc-a207f9ff4825 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:10.736807 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:10.737897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:10.738353 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:10.742872 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:10.997793 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:10.998874 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:10.999379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lazy-loading 'fault' on Instance uuid dae2ea5f-aa16-40d5-92bf-05bd9125a483 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:01:11.074117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-168cac8b-b868-4bd1-a2dc-a207f9ff4825 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:11.074592 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe59d1f996e4abdb8a90b7444133e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e491322c9bb146359268dcd649f24662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:11.082836 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fb29f1f9-5aa3-4c67-9a15-369ab4d391c9 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 200 len: 1304 microversion: 2.1 time: 0.372844 Jun 22 17:01:11.083404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 143/289] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:10 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 1304 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:11.090294 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-168cac8b-b868-4bd1-a2dc-a207f9ff4825 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.391035 Jun 22 17:01:11.093452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6df4380c-7187-4280-9950-3173c33a2391 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:11.093691 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 147/290] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:10 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:11.093774 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6df4380c-7187-4280-9950-3173c33a2391 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:11.111838 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6df4380c-7187-4280-9950-3173c33a2391 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:11.112594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6df4380c-7187-4280-9950-3173c33a2391 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:11.114840 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6df4380c-7187-4280-9950-3173c33a2391 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:11.114840 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6df4380c-7187-4280-9950-3173c33a2391 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:11.429130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6df4380c-7187-4280-9950-3173c33a2391 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:11.437936 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6df4380c-7187-4280-9950-3173c33a2391 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1295 microversion: 2.1 time: 0.353456 Jun 22 17:01:11.438901 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 144/291] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:11 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1295 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:12.115070 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-11fcff9a-13e3-4afa-8793-1d6bb59b5e75 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:12.117208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-11fcff9a-13e3-4afa-8793-1d6bb59b5e75 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:12.122431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:12.123070 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] [instance: dae2ea5f-aa16-40d5-92bf-05bd9125a483] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:12.123708 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11fcff9a-13e3-4afa-8793-1d6bb59b5e75 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:12.131692 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11fcff9a-13e3-4afa-8793-1d6bb59b5e75 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:12.132844 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11fcff9a-13e3-4afa-8793-1d6bb59b5e75 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:12.133516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11fcff9a-13e3-4afa-8793-1d6bb59b5e75 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:12.136499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:12.137110 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:12.138246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:12.141520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:12.177076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] HTTP exception thrown: Instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 could not be found. Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Request method failure captured: Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 HTTP/1.1 Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0qDu2bJS_8JYJAu4v1aUZ6yPqBHBvDJIorQjmP_YPdYteWhFJnk8CfDEqG3i1OUad5_qsODOhcP-_LI-ppanl3ygT7uR3DB1QRqf35knYC_0hzOfJ1GM5Qf6KlSZnbq1MYa_hPa8y6KQGhgfkuuBetyQoBB-u9-NAGmAkKowK9TSxc Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: e491322c9bb146359268dcd649f24662 Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesActionsTest-1729851509 Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:01:12.178919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e491322c9bb146359268dcd649f24662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e491322c9bb146359268dcd649f24662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e491322c9bb146359268dcd649f24662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e491322c9bb146359268dcd649f24662"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesActionsTest-1729851509 Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: e491322c9bb146359268dcd649f24662 Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesActionsTest-1729851509 Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesActionsTest-1729851509-project Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 1fe59d1f996e4abdb8a90b7444133e1c Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesActionsTest-1729851509-project Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 could not be found. Jun 22 17:01:12.180281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': 'dae2ea5f-aa16-40d5-92bf-05bd9125a483'} Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 could not be found. Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:01:12.180985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 could not be found. Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 could not be found. Jun 22 17:01:12.183167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:01:12.190311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] Returning 404 to user: Instance dae2ea5f-aa16-40d5-92bf-05bd9125a483 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:01:12.190311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0bf6515d-873b-4edc-9a08-a4d5e133ffd6 tempest-VolumesActionsTest-1729851509 tempest-VolumesActionsTest-1729851509-project] 10.222.0.18 "GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483" status: 404 len: 111 microversion: 2.1 time: 0.062216 Jun 22 17:01:12.190311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 145/292] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:12 2022] GET /compute/v2.1/servers/dae2ea5f-aa16-40d5-92bf-05bd9125a483 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:01:12.332687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-11fcff9a-13e3-4afa-8793-1d6bb59b5e75 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:12.344739 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-11fcff9a-13e3-4afa-8793-1d6bb59b5e75 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.233154 Jun 22 17:01:12.354983 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 148/293] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:12 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:12.455574 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-81a533b4-7d69-4e3f-9d44-9fa342e69703 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:12.456223 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-81a533b4-7d69-4e3f-9d44-9fa342e69703 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:12.464149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-81a533b4-7d69-4e3f-9d44-9fa342e69703 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:12.464741 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-81a533b4-7d69-4e3f-9d44-9fa342e69703 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:12.465912 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-81a533b4-7d69-4e3f-9d44-9fa342e69703 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:12.466531 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-81a533b4-7d69-4e3f-9d44-9fa342e69703 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:12.772098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-81a533b4-7d69-4e3f-9d44-9fa342e69703 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:12.780175 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-81a533b4-7d69-4e3f-9d44-9fa342e69703 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.329087 Jun 22 17:01:12.790054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 146/294] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:12 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:13.368013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e9af5b3a-4ffa-4efb-85c3-08541353a577 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:13.369625 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e9af5b3a-4ffa-4efb-85c3-08541353a577 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:13.379479 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e9af5b3a-4ffa-4efb-85c3-08541353a577 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:13.380396 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e9af5b3a-4ffa-4efb-85c3-08541353a577 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:13.381525 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e9af5b3a-4ffa-4efb-85c3-08541353a577 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:13.382322 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e9af5b3a-4ffa-4efb-85c3-08541353a577 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:13.684470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e9af5b3a-4ffa-4efb-85c3-08541353a577 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:13.684470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:13.696545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e9af5b3a-4ffa-4efb-85c3-08541353a577 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.336234 Jun 22 17:01:13.697197 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 149/295] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:13 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:13.783552 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1688611056", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "260e6a41-6ed6-45a7-8ce9-f798c1704919"}], "security_groups": [{"name": "tempest-securitygroup--1626283979"}], "key_name": "tempest-keypair-1652442716", "user_data": "}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:13.799854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-242b1134-4d8a-4a16-bf0f-2e8fa63d1df4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:13.800529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-242b1134-4d8a-4a16-bf0f-2e8fa63d1df4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:13.813594 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-242b1134-4d8a-4a16-bf0f-2e8fa63d1df4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:13.814497 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-242b1134-4d8a-4a16-bf0f-2e8fa63d1df4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:13.815549 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-242b1134-4d8a-4a16-bf0f-2e8fa63d1df4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:13.816603 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-242b1134-4d8a-4a16-bf0f-2e8fa63d1df4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:13.967800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] validate_networks() for [('260e6a41-6ed6-45a7-8ce9-f798c1704919', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:01:13.978692 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-242b1134-4d8a-4a16-bf0f-2e8fa63d1df4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:13.996835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-242b1134-4d8a-4a16-bf0f-2e8fa63d1df4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.199049 Jun 22 17:01:13.996835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 150/296] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:13 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:14.041381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-ec967bb6-cbec-447b-8878-d6fc4c0106ac req-562d1556-8887-45a2-9217-d92195af219b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5168389e-f141-4e31-9c66-a365b612cd02", "tag": "3454e07e-a024-4526-ac2b-c399f260725f"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:14.063721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-ec967bb6-cbec-447b-8878-d6fc4c0106ac req-562d1556-8887-45a2-9217-d92195af219b service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:14.064186 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-ec967bb6-cbec-447b-8878-d6fc4c0106ac req-562d1556-8887-45a2-9217-d92195af219b service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:14.078379 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-ec967bb6-cbec-447b-8878-d6fc4c0106ac req-562d1556-8887-45a2-9217-d92195af219b service nova] Creating event network-changed:3454e07e-a024-4526-ac2b-c399f260725f for instance 5168389e-f141-4e31-9c66-a365b612cd02 on hv-cinder-81045 Jun 22 17:01:14.084805 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-ec967bb6-cbec-447b-8878-d6fc4c0106ac req-562d1556-8887-45a2-9217-d92195af219b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047120 Jun 22 17:01:14.086000 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 151/297] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:01:14.714163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-779b4cc8-c625-4464-92cb-dac7a6699dc9 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:14.715614 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-779b4cc8-c625-4464-92cb-dac7a6699dc9 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:14.723537 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-779b4cc8-c625-4464-92cb-dac7a6699dc9 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:14.724358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-779b4cc8-c625-4464-92cb-dac7a6699dc9 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:14.725639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-779b4cc8-c625-4464-92cb-dac7a6699dc9 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:14.726220 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-779b4cc8-c625-4464-92cb-dac7a6699dc9 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:14.749345 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:01:14.749751 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:01:14.755171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:01:14.755171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:01:14.755171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:01:14.771607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:14.772351 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:14.778344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:14.778344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:14.794967 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Getting quotas for project 47bd5d8cddc94945b967b114d49f086c. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:01:14.804068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Getting quotas for user 276147f205ae43da9df678dcd572115a and project 47bd5d8cddc94945b967b114d49f086c. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:01:14.821205 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:01:14.823990 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:01:14.933842 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9fe59cda-aead-4425-82a7-f1de8b7a028c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.156018 Jun 22 17:01:14.934485 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 147/298] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:01:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:01:14.939636 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-2ba4659e-d317-4985-883d-a41d579d48e2 req-5ce09875-d798-4383-9c21-c120037ee739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7", "name": "network-vif-plugged", "status": "completed", "tag": "e61ff2d2-caee-48ec-9f7f-99f64a4cfeaf"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:14.948654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-779b4cc8-c625-4464-92cb-dac7a6699dc9 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:14.953918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2ba4659e-d317-4985-883d-a41d579d48e2 req-5ce09875-d798-4383-9c21-c120037ee739 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:14.954659 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2ba4659e-d317-4985-883d-a41d579d48e2 req-5ce09875-d798-4383-9c21-c120037ee739 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:14.958411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-779b4cc8-c625-4464-92cb-dac7a6699dc9 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.248998 Jun 22 17:01:14.958985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 152/299] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:14 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:14.963405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a70275f9-b000-4750-a326-2ad3e48b9613 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:14.964646 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a70275f9-b000-4750-a326-2ad3e48b9613 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:14.974358 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-2ba4659e-d317-4985-883d-a41d579d48e2 req-5ce09875-d798-4383-9c21-c120037ee739 service nova] Creating event network-vif-plugged:e61ff2d2-caee-48ec-9f7f-99f64a4cfeaf for instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 on hv-cinder-81045 Jun 22 17:01:14.979687 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-2ba4659e-d317-4985-883d-a41d579d48e2 req-5ce09875-d798-4383-9c21-c120037ee739 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043918 Jun 22 17:01:14.980312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 148/300] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:15.019293 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-43c2de30-89f5-4de2-a2f7-c64b1a755a73 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:15.020212 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-43c2de30-89f5-4de2-a2f7-c64b1a755a73 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:15.030430 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-43c2de30-89f5-4de2-a2f7-c64b1a755a73 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:15.031081 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-43c2de30-89f5-4de2-a2f7-c64b1a755a73 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:15.032395 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-43c2de30-89f5-4de2-a2f7-c64b1a755a73 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:15.032976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-43c2de30-89f5-4de2-a2f7-c64b1a755a73 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:15.095371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a70275f9-b000-4750-a326-2ad3e48b9613 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:15.101217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=29 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:15.103138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a70275f9-b000-4750-a326-2ad3e48b9613 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1246 microversion: 2.1 time: 0.143211 Jun 22 17:01:15.109081 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 153/301] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:14 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1246 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:15.278485 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-43c2de30-89f5-4de2-a2f7-c64b1a755a73 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:15.291269 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-43c2de30-89f5-4de2-a2f7-c64b1a755a73 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.276747 Jun 22 17:01:15.292429 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 149/302] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:15 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:15.975718 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5a73ee5f-d51b-4c5a-9deb-3cfbcae45821 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:15.976330 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5a73ee5f-d51b-4c5a-9deb-3cfbcae45821 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:15.985465 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5a73ee5f-d51b-4c5a-9deb-3cfbcae45821 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:15.986026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5a73ee5f-d51b-4c5a-9deb-3cfbcae45821 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:15.986702 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5a73ee5f-d51b-4c5a-9deb-3cfbcae45821 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:15.987136 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5a73ee5f-d51b-4c5a-9deb-3cfbcae45821 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:16.120342 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5a73ee5f-d51b-4c5a-9deb-3cfbcae45821 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:16.124446 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-42d7abfd-6851-4f29-9d0e-fad4ecfb25bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:16.125639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-42d7abfd-6851-4f29-9d0e-fad4ecfb25bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:16.129056 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5a73ee5f-d51b-4c5a-9deb-3cfbcae45821 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.158152 Jun 22 17:01:16.129867 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 154/303] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:15 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:16.142052 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42d7abfd-6851-4f29-9d0e-fad4ecfb25bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:16.142606 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42d7abfd-6851-4f29-9d0e-fad4ecfb25bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:16.143574 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42d7abfd-6851-4f29-9d0e-fad4ecfb25bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:16.144018 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42d7abfd-6851-4f29-9d0e-fad4ecfb25bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:16.220814 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-42d7abfd-6851-4f29-9d0e-fad4ecfb25bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:16.228642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-42d7abfd-6851-4f29-9d0e-fad4ecfb25bc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1250 microversion: 2.1 time: 0.109950 Jun 22 17:01:16.229205 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 150/304] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:16 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1250 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:16.313152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-115bbcf9-3ba6-4e13-acd7-c2359f7de1b4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:16.313152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-115bbcf9-3ba6-4e13-acd7-c2359f7de1b4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:16.316272 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-115bbcf9-3ba6-4e13-acd7-c2359f7de1b4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:16.316712 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-115bbcf9-3ba6-4e13-acd7-c2359f7de1b4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:16.317482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-115bbcf9-3ba6-4e13-acd7-c2359f7de1b4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:16.325874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-115bbcf9-3ba6-4e13-acd7-c2359f7de1b4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:16.460059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-115bbcf9-3ba6-4e13-acd7-c2359f7de1b4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:16.467608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-115bbcf9-3ba6-4e13-acd7-c2359f7de1b4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.162161 Jun 22 17:01:16.468275 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 155/305] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:16 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:17.147087 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-32fc58a2-e22d-448b-ac23-97551e6db960 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:17.148298 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-32fc58a2-e22d-448b-ac23-97551e6db960 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:17.155727 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32fc58a2-e22d-448b-ac23-97551e6db960 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:17.156299 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32fc58a2-e22d-448b-ac23-97551e6db960 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:17.157220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32fc58a2-e22d-448b-ac23-97551e6db960 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:17.157829 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32fc58a2-e22d-448b-ac23-97551e6db960 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:17.247896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-43924836-ad7c-44ad-8dcb-a0a8d3ccdc84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:17.248607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-43924836-ad7c-44ad-8dcb-a0a8d3ccdc84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:17.255865 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43924836-ad7c-44ad-8dcb-a0a8d3ccdc84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:17.256516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43924836-ad7c-44ad-8dcb-a0a8d3ccdc84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:17.257442 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43924836-ad7c-44ad-8dcb-a0a8d3ccdc84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:17.258026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43924836-ad7c-44ad-8dcb-a0a8d3ccdc84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:17.307339 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-32fc58a2-e22d-448b-ac23-97551e6db960 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:17.318486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-32fc58a2-e22d-448b-ac23-97551e6db960 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.176094 Jun 22 17:01:17.319799 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 151/306] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:17 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:17.335512 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-43924836-ad7c-44ad-8dcb-a0a8d3ccdc84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:17.345221 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-43924836-ad7c-44ad-8dcb-a0a8d3ccdc84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1250 microversion: 2.1 time: 0.102063 Jun 22 17:01:17.345997 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 156/307] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:17 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1250 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:17.484526 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4fbb6f11-36f7-44ec-84d5-b9957982bca1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:17.485131 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4fbb6f11-36f7-44ec-84d5-b9957982bca1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:17.491287 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4fbb6f11-36f7-44ec-84d5-b9957982bca1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:17.491847 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4fbb6f11-36f7-44ec-84d5-b9957982bca1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:17.492734 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4fbb6f11-36f7-44ec-84d5-b9957982bca1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:17.493164 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4fbb6f11-36f7-44ec-84d5-b9957982bca1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:17.644335 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4fbb6f11-36f7-44ec-84d5-b9957982bca1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:17.653585 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4fbb6f11-36f7-44ec-84d5-b9957982bca1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.172757 Jun 22 17:01:17.654284 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 152/308] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:17 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:18.335928 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cfd8c669-a6cd-4ee3-8bc0-ccc6eec9c558 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:18.336681 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-cfd8c669-a6cd-4ee3-8bc0-ccc6eec9c558 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:18.344038 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cfd8c669-a6cd-4ee3-8bc0-ccc6eec9c558 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:18.344508 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cfd8c669-a6cd-4ee3-8bc0-ccc6eec9c558 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:18.345532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cfd8c669-a6cd-4ee3-8bc0-ccc6eec9c558 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:18.345974 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cfd8c669-a6cd-4ee3-8bc0-ccc6eec9c558 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:18.363478 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0248f4c6-feaa-4ee5-b7f6-4917ed669870 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:18.364287 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0248f4c6-feaa-4ee5-b7f6-4917ed669870 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:18.371761 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0248f4c6-feaa-4ee5-b7f6-4917ed669870 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:18.372395 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0248f4c6-feaa-4ee5-b7f6-4917ed669870 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:18.373565 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0248f4c6-feaa-4ee5-b7f6-4917ed669870 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:18.374143 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0248f4c6-feaa-4ee5-b7f6-4917ed669870 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:18.435727 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0248f4c6-feaa-4ee5-b7f6-4917ed669870 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:18.443106 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0248f4c6-feaa-4ee5-b7f6-4917ed669870 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1250 microversion: 2.1 time: 0.084265 Jun 22 17:01:18.443658 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 153/309] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:18 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:18.475427 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cfd8c669-a6cd-4ee3-8bc0-ccc6eec9c558 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:18.483735 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cfd8c669-a6cd-4ee3-8bc0-ccc6eec9c558 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.151907 Jun 22 17:01:18.484540 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 157/310] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:18 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:18.673455 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a89642ea-eed9-40b4-a41b-7a212e293164 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:18.673455 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a89642ea-eed9-40b4-a41b-7a212e293164 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:18.678524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a89642ea-eed9-40b4-a41b-7a212e293164 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:18.678524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a89642ea-eed9-40b4-a41b-7a212e293164 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:18.679271 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a89642ea-eed9-40b4-a41b-7a212e293164 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:18.679705 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a89642ea-eed9-40b4-a41b-7a212e293164 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:18.807899 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a89642ea-eed9-40b4-a41b-7a212e293164 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:18.815153 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a89642ea-eed9-40b4-a41b-7a212e293164 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.148296 Jun 22 17:01:18.815697 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 154/311] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:18 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:19.459032 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-adf9219a-2e4b-4a33-b202-540f285cd687 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:19.459663 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-adf9219a-2e4b-4a33-b202-540f285cd687 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:19.466121 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-adf9219a-2e4b-4a33-b202-540f285cd687 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:19.466560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-adf9219a-2e4b-4a33-b202-540f285cd687 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:19.467313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-adf9219a-2e4b-4a33-b202-540f285cd687 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:19.468377 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-adf9219a-2e4b-4a33-b202-540f285cd687 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:19.501093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1c16327f-1cb5-4b09-b95b-9781995ee97f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:19.501704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1c16327f-1cb5-4b09-b95b-9781995ee97f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:19.507639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1c16327f-1cb5-4b09-b95b-9781995ee97f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:19.508087 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1c16327f-1cb5-4b09-b95b-9781995ee97f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:19.508879 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1c16327f-1cb5-4b09-b95b-9781995ee97f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:19.509312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1c16327f-1cb5-4b09-b95b-9781995ee97f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:19.529031 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-adf9219a-2e4b-4a33-b202-540f285cd687 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:19.538275 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-adf9219a-2e4b-4a33-b202-540f285cd687 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1250 microversion: 2.1 time: 0.082873 Jun 22 17:01:19.538841 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 158/312] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:19 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:19.635716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1c16327f-1cb5-4b09-b95b-9781995ee97f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:19.643130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1c16327f-1cb5-4b09-b95b-9781995ee97f tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.145901 Jun 22 17:01:19.643688 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 155/313] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:19 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:19.835476 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bd55df96-368e-4e9a-86ba-a5f20c50c33d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:19.836195 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bd55df96-368e-4e9a-86ba-a5f20c50c33d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:19.844349 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd55df96-368e-4e9a-86ba-a5f20c50c33d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:19.844795 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd55df96-368e-4e9a-86ba-a5f20c50c33d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:19.845565 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd55df96-368e-4e9a-86ba-a5f20c50c33d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:19.847786 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd55df96-368e-4e9a-86ba-a5f20c50c33d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:19.996796 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bd55df96-368e-4e9a-86ba-a5f20c50c33d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:20.004888 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bd55df96-368e-4e9a-86ba-a5f20c50c33d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.175949 Jun 22 17:01:20.015089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 159/314] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:19 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:20.555803 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ac839db0-e321-4c44-943b-e66f589437ab tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:20.556648 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ac839db0-e321-4c44-943b-e66f589437ab tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:20.562691 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ac839db0-e321-4c44-943b-e66f589437ab tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:20.563221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ac839db0-e321-4c44-943b-e66f589437ab tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:20.563989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ac839db0-e321-4c44-943b-e66f589437ab tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:20.564457 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ac839db0-e321-4c44-943b-e66f589437ab tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:20.624582 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ac839db0-e321-4c44-943b-e66f589437ab tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:20.631771 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ac839db0-e321-4c44-943b-e66f589437ab tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1298 microversion: 2.1 time: 0.079939 Jun 22 17:01:20.632353 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 156/315] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:20 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1298 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:20.659761 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6d3b985c-6841-47cd-9648-716a1235401c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:20.660412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6d3b985c-6841-47cd-9648-716a1235401c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:20.666772 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6d3b985c-6841-47cd-9648-716a1235401c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:20.667213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6d3b985c-6841-47cd-9648-716a1235401c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:20.667960 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6d3b985c-6841-47cd-9648-716a1235401c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:20.668422 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6d3b985c-6841-47cd-9648-716a1235401c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:20.798591 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6d3b985c-6841-47cd-9648-716a1235401c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:20.806013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6d3b985c-6841-47cd-9648-716a1235401c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.150612 Jun 22 17:01:20.808051 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 160/316] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:20 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:21.022153 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f68a0216-d84a-4370-88f1-3e414533bd05 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:21.022864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f68a0216-d84a-4370-88f1-3e414533bd05 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:21.029226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f68a0216-d84a-4370-88f1-3e414533bd05 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:21.029676 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f68a0216-d84a-4370-88f1-3e414533bd05 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:21.030536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f68a0216-d84a-4370-88f1-3e414533bd05 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:21.030972 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f68a0216-d84a-4370-88f1-3e414533bd05 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:21.161380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f68a0216-d84a-4370-88f1-3e414533bd05 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:21.168889 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f68a0216-d84a-4370-88f1-3e414533bd05 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.150599 Jun 22 17:01:21.169446 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 157/317] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:21 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:22.124968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2adaaaf0-e69c-4b76-ac87-1b717896abd7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:22.124968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2adaaaf0-e69c-4b76-ac87-1b717896abd7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:22.124968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2adaaaf0-e69c-4b76-ac87-1b717896abd7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:22.124968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2adaaaf0-e69c-4b76-ac87-1b717896abd7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:22.128203 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2adaaaf0-e69c-4b76-ac87-1b717896abd7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:22.128203 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2adaaaf0-e69c-4b76-ac87-1b717896abd7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:22.128203 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2adaaaf0-e69c-4b76-ac87-1b717896abd7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:22.128203 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:22.129219 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2adaaaf0-e69c-4b76-ac87-1b717896abd7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1298 microversion: 2.1 time: 0.092330 Jun 22 17:01:22.129219 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 161/318] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:21 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:22.129418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b6b904d1-073b-4339-a303-da62e8294b30 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:22.129418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b6b904d1-073b-4339-a303-da62e8294b30 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:22.129418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6b904d1-073b-4339-a303-da62e8294b30 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:22.129418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6b904d1-073b-4339-a303-da62e8294b30 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:22.130063 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6b904d1-073b-4339-a303-da62e8294b30 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:22.130063 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6b904d1-073b-4339-a303-da62e8294b30 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:22.130063 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b6b904d1-073b-4339-a303-da62e8294b30 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:22.130322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b6b904d1-073b-4339-a303-da62e8294b30 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.151952 Jun 22 17:01:22.130322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 158/319] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:21 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:22.185589 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f66daa2b-a598-47db-88fb-41a53bc2f1db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:22.186261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f66daa2b-a598-47db-88fb-41a53bc2f1db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:22.193396 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f66daa2b-a598-47db-88fb-41a53bc2f1db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:22.193847 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f66daa2b-a598-47db-88fb-41a53bc2f1db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:22.194801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f66daa2b-a598-47db-88fb-41a53bc2f1db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:22.195207 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f66daa2b-a598-47db-88fb-41a53bc2f1db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:22.235495 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-534215909", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "networks": [{"uuid": "430ac38b-6632-4da8-86db-9d079cd300c2"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:22.333437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f66daa2b-a598-47db-88fb-41a53bc2f1db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:22.340853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f66daa2b-a598-47db-88fb-41a53bc2f1db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.159279 Jun 22 17:01:22.341566 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 162/320] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:22 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:23.135358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7a0b9754-b61e-4572-9fb7-ee43c215c47f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:23.136132 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7a0b9754-b61e-4572-9fb7-ee43c215c47f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:23.143813 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7a0b9754-b61e-4572-9fb7-ee43c215c47f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:23.144304 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7a0b9754-b61e-4572-9fb7-ee43c215c47f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:23.145287 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7a0b9754-b61e-4572-9fb7-ee43c215c47f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:23.145725 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7a0b9754-b61e-4572-9fb7-ee43c215c47f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:23.224474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7a0b9754-b61e-4572-9fb7-ee43c215c47f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:23.233770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7a0b9754-b61e-4572-9fb7-ee43c215c47f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1298 microversion: 2.1 time: 0.103195 Jun 22 17:01:23.235401 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 163/321] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:23 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:23.241360 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ba399df0-c9f6-49d2-b54d-d53dbd98d933 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:23.242107 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ba399df0-c9f6-49d2-b54d-d53dbd98d933 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:23.248941 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ba399df0-c9f6-49d2-b54d-d53dbd98d933 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:23.249520 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ba399df0-c9f6-49d2-b54d-d53dbd98d933 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:23.250381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ba399df0-c9f6-49d2-b54d-d53dbd98d933 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:23.250909 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ba399df0-c9f6-49d2-b54d-d53dbd98d933 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:23.480495 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ba399df0-c9f6-49d2-b54d-d53dbd98d933 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:23.491664 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ba399df0-c9f6-49d2-b54d-d53dbd98d933 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.254124 Jun 22 17:01:23.492832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 164/322] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:23 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:23.505819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-43c02177-3597-4a7a-9604-bc07e565f40e tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:23.506812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-43c02177-3597-4a7a-9604-bc07e565f40e tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:23.521014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43c02177-3597-4a7a-9604-bc07e565f40e tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:23.521014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43c02177-3597-4a7a-9604-bc07e565f40e tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:23.521014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43c02177-3597-4a7a-9604-bc07e565f40e tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:23.521014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-43c02177-3597-4a7a-9604-bc07e565f40e tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:23.673012 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-43c02177-3597-4a7a-9604-bc07e565f40e tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:23.701964 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-43c02177-3597-4a7a-9604-bc07e565f40e tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.207774 Jun 22 17:01:23.702541 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 165/323] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:23 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:24.254641 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ecff0ceb-53d8-40fb-8d98-3fc2bae350a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:24.257650 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ecff0ceb-53d8-40fb-8d98-3fc2bae350a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:24.263036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:24.265271 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ecff0ceb-53d8-40fb-8d98-3fc2bae350a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:24.266044 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ecff0ceb-53d8-40fb-8d98-3fc2bae350a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:24.267571 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ecff0ceb-53d8-40fb-8d98-3fc2bae350a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:24.268382 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ecff0ceb-53d8-40fb-8d98-3fc2bae350a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:24.372325 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ecff0ceb-53d8-40fb-8d98-3fc2bae350a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:24.381145 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ecff0ceb-53d8-40fb-8d98-3fc2bae350a8 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1298 microversion: 2.1 time: 0.132749 Jun 22 17:01:24.384013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 166/324] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:24 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:24.510830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f5988027-0bfa-438e-97b7-a2f8ebe5b3fe tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:24.511906 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f5988027-0bfa-438e-97b7-a2f8ebe5b3fe tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:24.536860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f5988027-0bfa-438e-97b7-a2f8ebe5b3fe tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:24.537649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f5988027-0bfa-438e-97b7-a2f8ebe5b3fe tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:24.538797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f5988027-0bfa-438e-97b7-a2f8ebe5b3fe tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:24.539398 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f5988027-0bfa-438e-97b7-a2f8ebe5b3fe tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:24.787991 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:24.815961 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=12 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:24.858210 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f5988027-0bfa-438e-97b7-a2f8ebe5b3fe tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:24.876147 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f5988027-0bfa-438e-97b7-a2f8ebe5b3fe tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1315 microversion: 2.1 time: 0.370502 Jun 22 17:01:24.887839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 167/325] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:24 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:24.898563 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5c81491c-1e08-4b93-b8ab-78f418b1cfd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:24.899394 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5c81491c-1e08-4b93-b8ab-78f418b1cfd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:24.906391 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5c81491c-1e08-4b93-b8ab-78f418b1cfd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:24.906924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5c81491c-1e08-4b93-b8ab-78f418b1cfd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:24.909200 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5c81491c-1e08-4b93-b8ab-78f418b1cfd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:24.909747 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5c81491c-1e08-4b93-b8ab-78f418b1cfd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:25.223205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5c81491c-1e08-4b93-b8ab-78f418b1cfd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:25.237233 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5c81491c-1e08-4b93-b8ab-78f418b1cfd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.345414 Jun 22 17:01:25.238288 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 168/326] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:24 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:25.398907 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f7da4c99-9bf0-4dcb-b680-ac0c7b5e8829 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:25.399695 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f7da4c99-9bf0-4dcb-b680-ac0c7b5e8829 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:25.407613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7da4c99-9bf0-4dcb-b680-ac0c7b5e8829 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:25.408301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7da4c99-9bf0-4dcb-b680-ac0c7b5e8829 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:25.409224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7da4c99-9bf0-4dcb-b680-ac0c7b5e8829 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:25.409863 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7da4c99-9bf0-4dcb-b680-ac0c7b5e8829 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:25.547456 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f7da4c99-9bf0-4dcb-b680-ac0c7b5e8829 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:25.561295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f7da4c99-9bf0-4dcb-b680-ac0c7b5e8829 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1306 microversion: 2.1 time: 0.161691 Jun 22 17:01:25.572290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 169/327] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:25 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1306 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:25.612183 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-3ee66f29-cacc-4313-8079-4cb77f85ba29 req-4bedfb84-d5b4-4e47-8103-a53e557b29e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5168389e-f141-4e31-9c66-a365b612cd02", "name": "network-vif-plugged", "status": "completed", "tag": "3454e07e-a024-4526-ac2b-c399f260725f"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:25.623390 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-3ee66f29-cacc-4313-8079-4cb77f85ba29 req-4bedfb84-d5b4-4e47-8103-a53e557b29e9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:25.623853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-3ee66f29-cacc-4313-8079-4cb77f85ba29 req-4bedfb84-d5b4-4e47-8103-a53e557b29e9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:25.648113 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-3ee66f29-cacc-4313-8079-4cb77f85ba29 req-4bedfb84-d5b4-4e47-8103-a53e557b29e9 service nova] Creating event network-vif-plugged:3454e07e-a024-4526-ac2b-c399f260725f for instance 5168389e-f141-4e31-9c66-a365b612cd02 on hv-cinder-81045 Jun 22 17:01:25.654296 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-3ee66f29-cacc-4313-8079-4cb77f85ba29 req-4bedfb84-d5b4-4e47-8103-a53e557b29e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049948 Jun 22 17:01:25.660859 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 170/328] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:01:25.898706 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1e403e34-74ce-4269-962f-652e2cd042cd tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:25.899872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1e403e34-74ce-4269-962f-652e2cd042cd tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:25.913835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e403e34-74ce-4269-962f-652e2cd042cd tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:25.919117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e403e34-74ce-4269-962f-652e2cd042cd tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:25.919117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e403e34-74ce-4269-962f-652e2cd042cd tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:25.919117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e403e34-74ce-4269-962f-652e2cd042cd tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:26.095195 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:26.158828 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1e403e34-74ce-4269-962f-652e2cd042cd tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:26.171419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1e403e34-74ce-4269-962f-652e2cd042cd tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1465 microversion: 2.1 time: 0.280805 Jun 22 17:01:26.196164 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 171/329] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:25 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1465 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:26.231851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ae13067e-fb7c-4c32-a895-43b9f7255030 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:26.231851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ae13067e-fb7c-4c32-a895-43b9f7255030 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:26.245707 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ae13067e-fb7c-4c32-a895-43b9f7255030 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:26.246425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ae13067e-fb7c-4c32-a895-43b9f7255030 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:26.250057 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ae13067e-fb7c-4c32-a895-43b9f7255030 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:26.251463 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ae13067e-fb7c-4c32-a895-43b9f7255030 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:26.285469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ae13067e-fb7c-4c32-a895-43b9f7255030 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:01:26.770260 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ae13067e-fb7c-4c32-a895-43b9f7255030 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 204 len: 0 microversion: 2.1 time: 0.555607 Jun 22 17:01:26.774687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 172/330] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:01:26 2022] DELETE /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 17:01:26.781693 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-05d990d4-9a71-4e80-83d7-3926bc7ae169 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:26.782396 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-05d990d4-9a71-4e80-83d7-3926bc7ae169 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:26.791169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-05d990d4-9a71-4e80-83d7-3926bc7ae169 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:26.791685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-05d990d4-9a71-4e80-83d7-3926bc7ae169 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:26.792517 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-05d990d4-9a71-4e80-83d7-3926bc7ae169 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:26.792926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-05d990d4-9a71-4e80-83d7-3926bc7ae169 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:26.963857 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-05d990d4-9a71-4e80-83d7-3926bc7ae169 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:26.978115 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-05d990d4-9a71-4e80-83d7-3926bc7ae169 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.201999 Jun 22 17:01:26.988327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 173/331] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:26 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:26.988327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4071f7b2-d9c5-4a82-8519-f56377db5944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:26.988327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4071f7b2-d9c5-4a82-8519-f56377db5944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:26.995382 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4071f7b2-d9c5-4a82-8519-f56377db5944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:26.996006 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4071f7b2-d9c5-4a82-8519-f56377db5944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:26.997825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4071f7b2-d9c5-4a82-8519-f56377db5944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:26.998357 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4071f7b2-d9c5-4a82-8519-f56377db5944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:27.469187 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4071f7b2-d9c5-4a82-8519-f56377db5944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:27.478739 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4071f7b2-d9c5-4a82-8519-f56377db5944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.498325 Jun 22 17:01:27.484769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 174/332] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:26 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:27.484769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4e4b7361-830b-4203-a13e-efc33a9e3bb0 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:27.485041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4e4b7361-830b-4203-a13e-efc33a9e3bb0 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:27.495695 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4e4b7361-830b-4203-a13e-efc33a9e3bb0 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:27.500335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4e4b7361-830b-4203-a13e-efc33a9e3bb0 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:27.500335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4e4b7361-830b-4203-a13e-efc33a9e3bb0 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:27.500335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4e4b7361-830b-4203-a13e-efc33a9e3bb0 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:27.686536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4e4b7361-830b-4203-a13e-efc33a9e3bb0 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:27.713174 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4e4b7361-830b-4203-a13e-efc33a9e3bb0 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1471 microversion: 2.1 time: 0.232220 Jun 22 17:01:27.713804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 175/333] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:27 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:27.996411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-30ab2e22-bccb-4af6-9e3e-85fc1f845d8d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:27.998733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-30ab2e22-bccb-4af6-9e3e-85fc1f845d8d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:28.007439 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-30ab2e22-bccb-4af6-9e3e-85fc1f845d8d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:28.008259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-30ab2e22-bccb-4af6-9e3e-85fc1f845d8d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:28.009017 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-30ab2e22-bccb-4af6-9e3e-85fc1f845d8d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:28.009879 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-30ab2e22-bccb-4af6-9e3e-85fc1f845d8d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:28.168145 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-30ab2e22-bccb-4af6-9e3e-85fc1f845d8d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:28.176387 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-30ab2e22-bccb-4af6-9e3e-85fc1f845d8d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1362 microversion: 2.1 time: 0.183827 Jun 22 17:01:28.177260 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 176/334] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:27 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:28.496920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5ad85663-7c88-4eea-8594-176cc4eaa5f5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:28.497547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5ad85663-7c88-4eea-8594-176cc4eaa5f5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:28.507354 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5ad85663-7c88-4eea-8594-176cc4eaa5f5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:28.507865 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5ad85663-7c88-4eea-8594-176cc4eaa5f5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:28.508633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5ad85663-7c88-4eea-8594-176cc4eaa5f5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:28.509234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5ad85663-7c88-4eea-8594-176cc4eaa5f5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:28.530486 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:28.657012 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5ad85663-7c88-4eea-8594-176cc4eaa5f5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:28.665739 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5ad85663-7c88-4eea-8594-176cc4eaa5f5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.172873 Jun 22 17:01:28.666307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 177/335] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:28 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:28.731777 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-17fb3d27-835a-4ead-8a69-b84e6dbad1d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:28.732742 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-17fb3d27-835a-4ead-8a69-b84e6dbad1d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:28.744154 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17fb3d27-835a-4ead-8a69-b84e6dbad1d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:28.744154 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17fb3d27-835a-4ead-8a69-b84e6dbad1d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:28.744154 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17fb3d27-835a-4ead-8a69-b84e6dbad1d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:28.745339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17fb3d27-835a-4ead-8a69-b84e6dbad1d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:28.929656 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-17fb3d27-835a-4ead-8a69-b84e6dbad1d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:28.942189 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-17fb3d27-835a-4ead-8a69-b84e6dbad1d6 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1471 microversion: 2.1 time: 0.214086 Jun 22 17:01:28.943648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 178/336] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:28 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:29.193761 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b836ad51-4971-4c35-911c-98c9cd984995 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:29.195249 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b836ad51-4971-4c35-911c-98c9cd984995 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:29.203909 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b836ad51-4971-4c35-911c-98c9cd984995 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:29.204399 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b836ad51-4971-4c35-911c-98c9cd984995 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:29.206099 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b836ad51-4971-4c35-911c-98c9cd984995 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:29.206547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b836ad51-4971-4c35-911c-98c9cd984995 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:29.389436 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] validate_networks() for [('430ac38b-6632-4da8-86db-9d079cd300c2', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:01:29.458484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b836ad51-4971-4c35-911c-98c9cd984995 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:29.479807 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b836ad51-4971-4c35-911c-98c9cd984995 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1548 microversion: 2.1 time: 0.289255 Jun 22 17:01:29.482438 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 179/337] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:29 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1548 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:29.501386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-34f2fa02-d8b9-4f78-b6f6-51262b88601b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:29.503042 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-34f2fa02-d8b9-4f78-b6f6-51262b88601b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:29.527828 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34f2fa02-d8b9-4f78-b6f6-51262b88601b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:29.535055 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34f2fa02-d8b9-4f78-b6f6-51262b88601b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:29.536409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34f2fa02-d8b9-4f78-b6f6-51262b88601b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:29.542099 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34f2fa02-d8b9-4f78-b6f6-51262b88601b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:29.737830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-34f2fa02-d8b9-4f78-b6f6-51262b88601b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.244043 Jun 22 17:01:29.738423 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 180/338] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 17:01:29 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/os-interface => generated 285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:29.749296 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-419ba7f2-65a1-49a5-a094-470725e7f32d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:29.750194 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-419ba7f2-65a1-49a5-a094-470725e7f32d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:29.758624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-419ba7f2-65a1-49a5-a094-470725e7f32d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:29.759514 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-419ba7f2-65a1-49a5-a094-470725e7f32d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:29.760575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-419ba7f2-65a1-49a5-a094-470725e7f32d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:29.761233 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-419ba7f2-65a1-49a5-a094-470725e7f32d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:30.174428 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-419ba7f2-65a1-49a5-a094-470725e7f32d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:30.180149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:01:30.180612 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:01:30.181283 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:01:30.182645 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:01:30.182916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:01:30.184941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:30.186471 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-419ba7f2-65a1-49a5-a094-470725e7f32d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.440755 Jun 22 17:01:30.193316 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 181/339] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:29 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:30.203843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:30.204823 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:30.213839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:30.214423 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b3c278aa-21ec-4463-8a3c-adbd73faba05 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:30.214840 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:30.214920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b3c278aa-21ec-4463-8a3c-adbd73faba05 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:30.223746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b3c278aa-21ec-4463-8a3c-adbd73faba05 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:30.224242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b3c278aa-21ec-4463-8a3c-adbd73faba05 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:30.225015 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b3c278aa-21ec-4463-8a3c-adbd73faba05 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:30.225454 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b3c278aa-21ec-4463-8a3c-adbd73faba05 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:30.234712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Getting quotas for project d1b55c4096154398912c80d62bc2430b. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:01:30.240687 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Getting quotas for user eaa62b68f6704652b48d08fcba5e4798 and project d1b55c4096154398912c80d62bc2430b. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:01:30.265222 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:01:30.275304 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:01:30.480279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4e0c9b7c-cbf8-42f8-84a0-76e8a3f6dcf4 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.243821 Jun 22 17:01:30.480279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 159/340] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 8245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 17:01:30.501373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-6504348a-f167-423d-9e73-e43e45f0400e req-46ec85d2-d7f7-4d1d-841a-06e7258a9223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64220c7-ae61-46ea-ad86-122aee7e0a1a", "tag": "fcd6efe8-f80c-4c03-84a9-bd2560f1f166"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:30.524702 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-6504348a-f167-423d-9e73-e43e45f0400e req-46ec85d2-d7f7-4d1d-841a-06e7258a9223 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:30.526463 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-6504348a-f167-423d-9e73-e43e45f0400e req-46ec85d2-d7f7-4d1d-841a-06e7258a9223 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:30.555384 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-6504348a-f167-423d-9e73-e43e45f0400e req-46ec85d2-d7f7-4d1d-841a-06e7258a9223 service nova] Creating event network-changed:fcd6efe8-f80c-4c03-84a9-bd2560f1f166 for instance b64220c7-ae61-46ea-ad86-122aee7e0a1a on hv-cinder-81045 Jun 22 17:01:30.561204 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-6504348a-f167-423d-9e73-e43e45f0400e req-46ec85d2-d7f7-4d1d-841a-06e7258a9223 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076801 Jun 22 17:01:30.566123 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 160/341] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:30.572765 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-95e4cdd5-c56c-4b9f-bbf8-5aced0003db1 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:30.573531 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-95e4cdd5-c56c-4b9f-bbf8-5aced0003db1 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:30.738820 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-95e4cdd5-c56c-4b9f-bbf8-5aced0003db1 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:30.746497 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-95e4cdd5-c56c-4b9f-bbf8-5aced0003db1 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1218 microversion: 2.1 time: 0.179143 Jun 22 17:01:30.758739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 161/342] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:30 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:31.014994 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b3c278aa-21ec-4463-8a3c-adbd73faba05 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:31.034355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b3c278aa-21ec-4463-8a3c-adbd73faba05 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1471 microversion: 2.1 time: 0.840057 Jun 22 17:01:31.035526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 182/343] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:30 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1471 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:31.210697 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-54cf6578-a2b4-4f12-8692-a207cbeb4da2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:31.211423 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-54cf6578-a2b4-4f12-8692-a207cbeb4da2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:31.223848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54cf6578-a2b4-4f12-8692-a207cbeb4da2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:31.224412 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54cf6578-a2b4-4f12-8692-a207cbeb4da2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:31.225321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54cf6578-a2b4-4f12-8692-a207cbeb4da2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:31.225828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54cf6578-a2b4-4f12-8692-a207cbeb4da2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:31.399587 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-54cf6578-a2b4-4f12-8692-a207cbeb4da2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:31.414471 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-54cf6578-a2b4-4f12-8692-a207cbeb4da2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.207841 Jun 22 17:01:31.414471 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 162/344] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:31 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:31.763952 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-63ce8289-98f3-4e11-9f49-06338fb115c9 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:31.764707 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-63ce8289-98f3-4e11-9f49-06338fb115c9 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:31.910263 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-63ce8289-98f3-4e11-9f49-06338fb115c9 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:31.921759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-63ce8289-98f3-4e11-9f49-06338fb115c9 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1218 microversion: 2.1 time: 0.161385 Jun 22 17:01:31.935732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 183/345] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:31 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:32.061834 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e11b8cdc-127b-4602-8e82-008070858999 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:32.061834 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e11b8cdc-127b-4602-8e82-008070858999 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:32.069561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e11b8cdc-127b-4602-8e82-008070858999 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:32.074295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e11b8cdc-127b-4602-8e82-008070858999 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:32.074295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e11b8cdc-127b-4602-8e82-008070858999 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:32.074295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e11b8cdc-127b-4602-8e82-008070858999 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:32.255057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e11b8cdc-127b-4602-8e82-008070858999 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:32.264612 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:32.269309 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e11b8cdc-127b-4602-8e82-008070858999 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1429 microversion: 2.1 time: 0.220669 Jun 22 17:01:32.279849 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 163/346] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:32 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1429 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:32.364465 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-ec52c765-a0c8-49aa-a93d-f02bcec72956 req-4c5142b6-2446-4dc7-9746-6859bc588414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7", "name": "network-vif-deleted", "tag": "e61ff2d2-caee-48ec-9f7f-99f64a4cfeaf"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:32.386676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-ec52c765-a0c8-49aa-a93d-f02bcec72956 req-4c5142b6-2446-4dc7-9746-6859bc588414 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:32.387903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-ec52c765-a0c8-49aa-a93d-f02bcec72956 req-4c5142b6-2446-4dc7-9746-6859bc588414 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:32.400495 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-ec52c765-a0c8-49aa-a93d-f02bcec72956 req-4c5142b6-2446-4dc7-9746-6859bc588414 service nova] Creating event network-vif-deleted:e61ff2d2-caee-48ec-9f7f-99f64a4cfeaf for instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 on hv-cinder-81045 Jun 22 17:01:32.406421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-ec52c765-a0c8-49aa-a93d-f02bcec72956 req-4c5142b6-2446-4dc7-9746-6859bc588414 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071151 Jun 22 17:01:32.407028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 184/347] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:32.430684 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6727792d-aae7-4e6c-977e-e0de9f57293e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:32.431781 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6727792d-aae7-4e6c-977e-e0de9f57293e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:32.439629 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6727792d-aae7-4e6c-977e-e0de9f57293e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:32.440379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6727792d-aae7-4e6c-977e-e0de9f57293e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:32.441280 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6727792d-aae7-4e6c-977e-e0de9f57293e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:32.441899 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6727792d-aae7-4e6c-977e-e0de9f57293e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:32.607485 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6727792d-aae7-4e6c-977e-e0de9f57293e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:32.624794 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6727792d-aae7-4e6c-977e-e0de9f57293e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.197498 Jun 22 17:01:32.626062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 164/348] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:32 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:32.954434 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-028b08ee-e808-4e1f-9b36-8a4aaac23d27 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:32.955974 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-028b08ee-e808-4e1f-9b36-8a4aaac23d27 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:32.964028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-028b08ee-e808-4e1f-9b36-8a4aaac23d27 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:32.964597 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-028b08ee-e808-4e1f-9b36-8a4aaac23d27 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:32.965955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-028b08ee-e808-4e1f-9b36-8a4aaac23d27 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:32.966496 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-028b08ee-e808-4e1f-9b36-8a4aaac23d27 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:33.055708 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-028b08ee-e808-4e1f-9b36-8a4aaac23d27 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:33.068789 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-028b08ee-e808-4e1f-9b36-8a4aaac23d27 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1222 microversion: 2.1 time: 0.118942 Jun 22 17:01:33.077932 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 185/349] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:32 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:33.287551 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3eed1917-e637-43bf-a39e-73a49e7f6357 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:33.288170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3eed1917-e637-43bf-a39e-73a49e7f6357 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:33.294920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3eed1917-e637-43bf-a39e-73a49e7f6357 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:33.295685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3eed1917-e637-43bf-a39e-73a49e7f6357 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:33.296865 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3eed1917-e637-43bf-a39e-73a49e7f6357 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:33.297618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3eed1917-e637-43bf-a39e-73a49e7f6357 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:33.372087 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3eed1917-e637-43bf-a39e-73a49e7f6357 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:33.380298 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3eed1917-e637-43bf-a39e-73a49e7f6357 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1429 microversion: 2.1 time: 0.097202 Jun 22 17:01:33.391061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 165/350] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:33 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:33.643560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-af31a7ef-1dd6-4178-a80e-4b29ffdf8d0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:33.644192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-af31a7ef-1dd6-4178-a80e-4b29ffdf8d0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:33.650549 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-af31a7ef-1dd6-4178-a80e-4b29ffdf8d0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:33.650992 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-af31a7ef-1dd6-4178-a80e-4b29ffdf8d0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:33.651749 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-af31a7ef-1dd6-4178-a80e-4b29ffdf8d0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:33.652199 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-af31a7ef-1dd6-4178-a80e-4b29ffdf8d0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:33.794719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-af31a7ef-1dd6-4178-a80e-4b29ffdf8d0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:33.804331 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-af31a7ef-1dd6-4178-a80e-4b29ffdf8d0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.164823 Jun 22 17:01:33.805496 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 186/351] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:33 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:34.085386 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-816d6028-ca6a-43a9-9259-62aa622616b8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:34.086477 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-816d6028-ca6a-43a9-9259-62aa622616b8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:34.096894 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-816d6028-ca6a-43a9-9259-62aa622616b8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:34.101532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-816d6028-ca6a-43a9-9259-62aa622616b8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:34.101532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-816d6028-ca6a-43a9-9259-62aa622616b8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:34.101532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-816d6028-ca6a-43a9-9259-62aa622616b8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:34.176088 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-816d6028-ca6a-43a9-9259-62aa622616b8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:34.186679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-816d6028-ca6a-43a9-9259-62aa622616b8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1222 microversion: 2.1 time: 0.105491 Jun 22 17:01:34.187517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 166/352] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:34 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:34.398372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6f4c7ab7-14b7-4207-a3be-3fd22c17244c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:34.399065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6f4c7ab7-14b7-4207-a3be-3fd22c17244c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:34.406358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6f4c7ab7-14b7-4207-a3be-3fd22c17244c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:34.406877 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6f4c7ab7-14b7-4207-a3be-3fd22c17244c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:34.408226 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6f4c7ab7-14b7-4207-a3be-3fd22c17244c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:34.408901 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6f4c7ab7-14b7-4207-a3be-3fd22c17244c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:34.445875 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-1f517881-aced-4cef-b2af-5e4c24ee21a2 req-b761d18d-5f07-4110-90c9-91b775df94af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5168389e-f141-4e31-9c66-a365b612cd02", "tag": "3454e07e-a024-4526-ac2b-c399f260725f"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:34.457613 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1f517881-aced-4cef-b2af-5e4c24ee21a2 req-b761d18d-5f07-4110-90c9-91b775df94af service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:34.458727 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1f517881-aced-4cef-b2af-5e4c24ee21a2 req-b761d18d-5f07-4110-90c9-91b775df94af service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:34.473554 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-1f517881-aced-4cef-b2af-5e4c24ee21a2 req-b761d18d-5f07-4110-90c9-91b775df94af service nova] Creating event network-changed:3454e07e-a024-4526-ac2b-c399f260725f for instance 5168389e-f141-4e31-9c66-a365b612cd02 on hv-cinder-81045 Jun 22 17:01:34.479626 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-1f517881-aced-4cef-b2af-5e4c24ee21a2 req-b761d18d-5f07-4110-90c9-91b775df94af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038760 Jun 22 17:01:34.483232 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 167/353] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:01:34.522313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6f4c7ab7-14b7-4207-a3be-3fd22c17244c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:34.534676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6f4c7ab7-14b7-4207-a3be-3fd22c17244c tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1429 microversion: 2.1 time: 0.140161 Jun 22 17:01:34.535850 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 187/354] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:34 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:34.821621 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-041ceccf-f375-4656-bc4f-e97d69e8a8ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:34.822365 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-041ceccf-f375-4656-bc4f-e97d69e8a8ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:34.836133 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-041ceccf-f375-4656-bc4f-e97d69e8a8ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:34.845965 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-041ceccf-f375-4656-bc4f-e97d69e8a8ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:34.845965 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-041ceccf-f375-4656-bc4f-e97d69e8a8ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:34.845965 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-041ceccf-f375-4656-bc4f-e97d69e8a8ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:35.169728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-041ceccf-f375-4656-bc4f-e97d69e8a8ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:35.177776 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-041ceccf-f375-4656-bc4f-e97d69e8a8ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.360646 Jun 22 17:01:35.195745 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 168/355] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:34 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:35.204642 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d62a8b1e-88eb-47b3-aa82-f9b64a0667de tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:35.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d62a8b1e-88eb-47b3-aa82-f9b64a0667de tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:35.221183 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d62a8b1e-88eb-47b3-aa82-f9b64a0667de tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:35.221637 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d62a8b1e-88eb-47b3-aa82-f9b64a0667de tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:35.223476 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d62a8b1e-88eb-47b3-aa82-f9b64a0667de tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:35.224264 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d62a8b1e-88eb-47b3-aa82-f9b64a0667de tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:35.299111 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d62a8b1e-88eb-47b3-aa82-f9b64a0667de tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:35.306943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d62a8b1e-88eb-47b3-aa82-f9b64a0667de tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1214 microversion: 2.1 time: 0.107584 Jun 22 17:01:35.307527 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 188/356] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:35 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:35.569547 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:35.570978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:35.644269 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:35.644269 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:35.644269 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:35.644269 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:35.645046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:35.645046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:35.645046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lazy-loading 'fault' on Instance uuid 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:01:35.749535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf248c9dc99d4ee9a9fe20ef65be5c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1d98639af64f48966a2ba8d171895c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:35.770476 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c6c907e7-67da-4c43-862e-2ddf045cddf2 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 200 len: 1305 microversion: 2.1 time: 0.208270 Jun 22 17:01:35.770476 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 169/357] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:35 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:36.197193 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1c6b2b48-5cde-4f50-a92c-fa8f12da8c21 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:36.198666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1c6b2b48-5cde-4f50-a92c-fa8f12da8c21 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:36.223847 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1c6b2b48-5cde-4f50-a92c-fa8f12da8c21 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:36.226778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1c6b2b48-5cde-4f50-a92c-fa8f12da8c21 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:36.231186 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1c6b2b48-5cde-4f50-a92c-fa8f12da8c21 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:36.234259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1c6b2b48-5cde-4f50-a92c-fa8f12da8c21 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:36.336841 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-828cbebe-b72e-4867-8c83-64edda50d295 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:36.337851 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-828cbebe-b72e-4867-8c83-64edda50d295 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:36.346527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-828cbebe-b72e-4867-8c83-64edda50d295 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:36.347245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-828cbebe-b72e-4867-8c83-64edda50d295 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:36.349673 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-828cbebe-b72e-4867-8c83-64edda50d295 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:36.350212 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-828cbebe-b72e-4867-8c83-64edda50d295 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:36.587092 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1c6b2b48-5cde-4f50-a92c-fa8f12da8c21 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:36.596324 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1c6b2b48-5cde-4f50-a92c-fa8f12da8c21 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.403567 Jun 22 17:01:36.606072 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 189/358] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:36 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:36.783643 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:36.784536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] [instance: 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:36.801345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:36.801345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:36.808041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:36.808537 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:36.857237 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] HTTP exception thrown: Instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 could not be found. Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Request method failure captured: Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 HTTP/1.1 Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0rBrrqnb9ZjLUr4kWAF54O0g0r8-c35Ncc5gOyxWICCR4-WAGIKEb4QZr8dNnqU5i58kWdBVTMpAtTFD7VpzTzRneawodONfx2UpJY3C5rttcM408_m9IeOSddTWzHQWNsCbQ-fN8bRzb0dhwhb8yPi4t6bBf04CZulKHwsGKoePMI Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 5c1d98639af64f48966a2ba8d171895c Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesNegativeTest-824320522 Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:01:36.874955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c1d98639af64f48966a2ba8d171895c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c1d98639af64f48966a2ba8d171895c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c1d98639af64f48966a2ba8d171895c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c1d98639af64f48966a2ba8d171895c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesNegativeTest-824320522 Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 5c1d98639af64f48966a2ba8d171895c Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesNegativeTest-824320522 Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesNegativeTest-824320522-project Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: bf248c9dc99d4ee9a9fe20ef65be5c02 Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesNegativeTest-824320522-project Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 could not be found. Jun 22 17:01:36.877076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7'} Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 could not be found. Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:01:36.878291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 could not be found. Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 could not be found. Jun 22 17:01:36.879542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:01:36.882051 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-828cbebe-b72e-4867-8c83-64edda50d295 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:36.882591 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] Returning 404 to user: Instance 9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:01:36.884176 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6e517f32-6d50-4ea4-8256-42b79c3990d1 tempest-VolumesNegativeTest-824320522 tempest-VolumesNegativeTest-824320522-project] 10.222.0.18 "GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7" status: 404 len: 111 microversion: 2.1 time: 0.098499 Jun 22 17:01:36.885565 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-828cbebe-b72e-4867-8c83-64edda50d295 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1270 microversion: 2.1 time: 0.559399 Jun 22 17:01:36.887060 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 170/360] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:36 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1270 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:36.887192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 190/360] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:36 2022] GET /compute/v2.1/servers/9d4fdbd5-9bf0-42b0-911a-179eb85bdcd7 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:01:37.623658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-52b846f4-d483-40aa-be21-9b22da6e76a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:37.624439 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-52b846f4-d483-40aa-be21-9b22da6e76a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:37.644027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-52b846f4-d483-40aa-be21-9b22da6e76a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:37.645370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-52b846f4-d483-40aa-be21-9b22da6e76a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:37.647570 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-52b846f4-d483-40aa-be21-9b22da6e76a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:37.647938 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-52b846f4-d483-40aa-be21-9b22da6e76a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:37.910473 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cd1ea2a5-975f-431c-9bee-7da7c2268583 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:37.911985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cd1ea2a5-975f-431c-9bee-7da7c2268583 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:37.922001 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd1ea2a5-975f-431c-9bee-7da7c2268583 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:37.922675 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd1ea2a5-975f-431c-9bee-7da7c2268583 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:37.924778 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd1ea2a5-975f-431c-9bee-7da7c2268583 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:37.926192 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd1ea2a5-975f-431c-9bee-7da7c2268583 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:37.937070 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-52b846f4-d483-40aa-be21-9b22da6e76a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:37.947451 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-52b846f4-d483-40aa-be21-9b22da6e76a3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.328923 Jun 22 17:01:37.949593 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 191/361] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:37 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:38.159819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-0366e535-859d-4c70-b36b-6f8496063cba req-0c8eef07-3ae1-4797-905c-a352b9b34d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64220c7-ae61-46ea-ad86-122aee7e0a1a", "name": "network-vif-plugged", "status": "completed", "tag": "fcd6efe8-f80c-4c03-84a9-bd2560f1f166"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:38.175076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-0366e535-859d-4c70-b36b-6f8496063cba req-0c8eef07-3ae1-4797-905c-a352b9b34d88 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:38.176413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-0366e535-859d-4c70-b36b-6f8496063cba req-0c8eef07-3ae1-4797-905c-a352b9b34d88 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:38.200535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cd1ea2a5-975f-431c-9bee-7da7c2268583 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:38.211972 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cd1ea2a5-975f-431c-9bee-7da7c2268583 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.307677 Jun 22 17:01:38.214485 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-0366e535-859d-4c70-b36b-6f8496063cba req-0c8eef07-3ae1-4797-905c-a352b9b34d88 service nova] Creating event network-vif-plugged:fcd6efe8-f80c-4c03-84a9-bd2560f1f166 for instance b64220c7-ae61-46ea-ad86-122aee7e0a1a on hv-cinder-81045 Jun 22 17:01:38.216345 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 171/362] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:37 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:38.233884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-0366e535-859d-4c70-b36b-6f8496063cba req-0c8eef07-3ae1-4797-905c-a352b9b34d88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079161 Jun 22 17:01:38.235011 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 192/363] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:38.966660 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-62d098e0-886d-439a-a249-aac767978e4d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:38.967978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-62d098e0-886d-439a-a249-aac767978e4d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:38.975372 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62d098e0-886d-439a-a249-aac767978e4d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:38.976091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62d098e0-886d-439a-a249-aac767978e4d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:38.977116 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62d098e0-886d-439a-a249-aac767978e4d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:38.977715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62d098e0-886d-439a-a249-aac767978e4d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:39.150165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-6048e0fb-4297-4d5c-9417-b63e490b5285 req-b8c4360e-83d7-4154-82f7-508708412218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a05301-1003-4be8-b8bd-824a620de060", "tag": "bc783111-9f8f-48c8-8d4f-6cc5af066635"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:39.181012 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-6048e0fb-4297-4d5c-9417-b63e490b5285 req-b8c4360e-83d7-4154-82f7-508708412218 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:39.190424 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-6048e0fb-4297-4d5c-9417-b63e490b5285 req-b8c4360e-83d7-4154-82f7-508708412218 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:39.222737 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-6048e0fb-4297-4d5c-9417-b63e490b5285 req-b8c4360e-83d7-4154-82f7-508708412218 service nova] Creating event network-changed:bc783111-9f8f-48c8-8d4f-6cc5af066635 for instance 97a05301-1003-4be8-b8bd-824a620de060 on hv-cinder-81045 Jun 22 17:01:39.228404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-62d098e0-886d-439a-a249-aac767978e4d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:39.229557 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-6048e0fb-4297-4d5c-9417-b63e490b5285 req-b8c4360e-83d7-4154-82f7-508708412218 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094201 Jun 22 17:01:39.230357 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 193/364] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:39.241217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3a5a8033-84e5-43ee-b3ad-80cbee5b42b3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:39.242022 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3a5a8033-84e5-43ee-b3ad-80cbee5b42b3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:39.244244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-62d098e0-886d-439a-a249-aac767978e4d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.282879 Jun 22 17:01:39.245867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 172/365] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:38 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:39.252298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a5a8033-84e5-43ee-b3ad-80cbee5b42b3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:39.256687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a5a8033-84e5-43ee-b3ad-80cbee5b42b3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:39.257504 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a5a8033-84e5-43ee-b3ad-80cbee5b42b3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:39.257948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a5a8033-84e5-43ee-b3ad-80cbee5b42b3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:39.574072 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a5a8033-84e5-43ee-b3ad-80cbee5b42b3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:39.599029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3a5a8033-84e5-43ee-b3ad-80cbee5b42b3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.367456 Jun 22 17:01:39.599830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 194/366] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:39 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:40.267609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fc68a0e0-3d63-4739-ae3a-7e0b4aa07ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:40.268355 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fc68a0e0-3d63-4739-ae3a-7e0b4aa07ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:40.278437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:40.280520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc68a0e0-3d63-4739-ae3a-7e0b4aa07ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:40.281073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc68a0e0-3d63-4739-ae3a-7e0b4aa07ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:40.283506 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc68a0e0-3d63-4739-ae3a-7e0b4aa07ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:40.283948 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc68a0e0-3d63-4739-ae3a-7e0b4aa07ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:40.490266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fc68a0e0-3d63-4739-ae3a-7e0b4aa07ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:40.502980 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fc68a0e0-3d63-4739-ae3a-7e0b4aa07ec2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1372 microversion: 2.1 time: 0.243366 Jun 22 17:01:40.513331 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 173/367] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:40 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:40.616340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e7743788-b9e1-4a8d-9c3d-c7cecb115f2d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:40.618248 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e7743788-b9e1-4a8d-9c3d-c7cecb115f2d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:40.634610 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e7743788-b9e1-4a8d-9c3d-c7cecb115f2d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:40.637176 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e7743788-b9e1-4a8d-9c3d-c7cecb115f2d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:40.638609 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e7743788-b9e1-4a8d-9c3d-c7cecb115f2d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:40.643661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e7743788-b9e1-4a8d-9c3d-c7cecb115f2d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:40.985996 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e7743788-b9e1-4a8d-9c3d-c7cecb115f2d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:40.994923 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e7743788-b9e1-4a8d-9c3d-c7cecb115f2d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.382868 Jun 22 17:01:40.996019 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 195/368] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:40 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:41.522279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-68fa3a59-ab6e-481b-a591-4fb1b84dca9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:41.523975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-68fa3a59-ab6e-481b-a591-4fb1b84dca9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:41.527648 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=8 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:41.532032 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-68fa3a59-ab6e-481b-a591-4fb1b84dca9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:41.533309 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-68fa3a59-ab6e-481b-a591-4fb1b84dca9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:41.534094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-68fa3a59-ab6e-481b-a591-4fb1b84dca9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:41.534532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-68fa3a59-ab6e-481b-a591-4fb1b84dca9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:41.811526 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-68fa3a59-ab6e-481b-a591-4fb1b84dca9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:41.825723 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-68fa3a59-ab6e-481b-a591-4fb1b84dca9d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1565 microversion: 2.1 time: 0.309082 Jun 22 17:01:41.826305 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 174/369] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:41 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1565 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:41.846348 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b7a82e8d-d444-4a35-a8ac-7ad75ac49c54 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:41.847405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b7a82e8d-d444-4a35-a8ac-7ad75ac49c54 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:41.860562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b7a82e8d-d444-4a35-a8ac-7ad75ac49c54 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:41.860562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b7a82e8d-d444-4a35-a8ac-7ad75ac49c54 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:41.860562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b7a82e8d-d444-4a35-a8ac-7ad75ac49c54 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:41.860562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b7a82e8d-d444-4a35-a8ac-7ad75ac49c54 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:41.921396 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:42.010354 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b7a82e8d-d444-4a35-a8ac-7ad75ac49c54 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170454 Jun 22 17:01:42.011445 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 196/370] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 17:01:41 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:42.022308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5dc93617-77b8-4ced-b7df-c282b6468a29 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:42.023145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5dc93617-77b8-4ced-b7df-c282b6468a29 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:42.035769 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5dc93617-77b8-4ced-b7df-c282b6468a29 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:42.036575 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5dc93617-77b8-4ced-b7df-c282b6468a29 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:42.041858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5dc93617-77b8-4ced-b7df-c282b6468a29 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:42.041858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5dc93617-77b8-4ced-b7df-c282b6468a29 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:42.432035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5dc93617-77b8-4ced-b7df-c282b6468a29 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:42.449584 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5dc93617-77b8-4ced-b7df-c282b6468a29 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.431201 Jun 22 17:01:42.453557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 175/371] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:42 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:43.468735 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4cd03835-b28d-4cdc-a24a-246f33f9d4ed tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:43.470026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4cd03835-b28d-4cdc-a24a-246f33f9d4ed tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:43.483369 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4cd03835-b28d-4cdc-a24a-246f33f9d4ed tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:43.483962 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4cd03835-b28d-4cdc-a24a-246f33f9d4ed tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:43.484887 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4cd03835-b28d-4cdc-a24a-246f33f9d4ed tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:43.487578 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4cd03835-b28d-4cdc-a24a-246f33f9d4ed tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:43.774557 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4cd03835-b28d-4cdc-a24a-246f33f9d4ed tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:43.790449 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-7a3c32e5-d588-4629-a15c-9caf260c1351 req-8ec9b9fa-723b-47a3-b4e3-fa805f994187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64220c7-ae61-46ea-ad86-122aee7e0a1a", "tag": "fcd6efe8-f80c-4c03-84a9-bd2560f1f166"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:43.803352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7a3c32e5-d588-4629-a15c-9caf260c1351 req-8ec9b9fa-723b-47a3-b4e3-fa805f994187 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:43.803821 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7a3c32e5-d588-4629-a15c-9caf260c1351 req-8ec9b9fa-723b-47a3-b4e3-fa805f994187 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:43.818349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-7a3c32e5-d588-4629-a15c-9caf260c1351 req-8ec9b9fa-723b-47a3-b4e3-fa805f994187 service nova] Creating event network-changed:fcd6efe8-f80c-4c03-84a9-bd2560f1f166 for instance b64220c7-ae61-46ea-ad86-122aee7e0a1a on hv-cinder-81045 Jun 22 17:01:43.821827 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4cd03835-b28d-4cdc-a24a-246f33f9d4ed tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.358871 Jun 22 17:01:43.825245 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 197/372] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:43 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:43.836056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-7a3c32e5-d588-4629-a15c-9caf260c1351 req-8ec9b9fa-723b-47a3-b4e3-fa805f994187 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062696 Jun 22 17:01:43.841848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 176/373] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:01:44.839179 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-11e26f75-6d79-4986-acc3-e386f2f1d0a2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:44.839780 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-11e26f75-6d79-4986-acc3-e386f2f1d0a2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:44.847454 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11e26f75-6d79-4986-acc3-e386f2f1d0a2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:44.847900 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11e26f75-6d79-4986-acc3-e386f2f1d0a2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:44.848988 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11e26f75-6d79-4986-acc3-e386f2f1d0a2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:44.849607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-11e26f75-6d79-4986-acc3-e386f2f1d0a2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:44.876458 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:45.007097 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-11e26f75-6d79-4986-acc3-e386f2f1d0a2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:45.016455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-11e26f75-6d79-4986-acc3-e386f2f1d0a2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.181390 Jun 22 17:01:45.017073 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 198/374] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:44 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:46.035322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fa79d68b-8eef-4167-8958-4010f182bc95 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:46.036064 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fa79d68b-8eef-4167-8958-4010f182bc95 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:46.042983 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa79d68b-8eef-4167-8958-4010f182bc95 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:46.045059 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa79d68b-8eef-4167-8958-4010f182bc95 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:46.045967 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa79d68b-8eef-4167-8958-4010f182bc95 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:46.046530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa79d68b-8eef-4167-8958-4010f182bc95 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:46.201933 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fa79d68b-8eef-4167-8958-4010f182bc95 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:46.210288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fa79d68b-8eef-4167-8958-4010f182bc95 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.179780 Jun 22 17:01:46.211121 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 177/375] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:46 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:47.227468 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0c9db224-2082-4e4d-a0f7-312e63664988 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:47.228075 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0c9db224-2082-4e4d-a0f7-312e63664988 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:47.234842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0c9db224-2082-4e4d-a0f7-312e63664988 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:47.235283 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0c9db224-2082-4e4d-a0f7-312e63664988 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:47.236725 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0c9db224-2082-4e4d-a0f7-312e63664988 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:47.237183 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0c9db224-2082-4e4d-a0f7-312e63664988 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:47.366306 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0c9db224-2082-4e4d-a0f7-312e63664988 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:47.374026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0c9db224-2082-4e4d-a0f7-312e63664988 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.150838 Jun 22 17:01:47.374666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 199/376] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:47 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:48.391026 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dc2e0dca-4610-413c-b979-88cb4eeccb64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:48.392957 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dc2e0dca-4610-413c-b979-88cb4eeccb64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:48.399351 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dc2e0dca-4610-413c-b979-88cb4eeccb64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:48.399861 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dc2e0dca-4610-413c-b979-88cb4eeccb64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:48.400813 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dc2e0dca-4610-413c-b979-88cb4eeccb64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:48.401296 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dc2e0dca-4610-413c-b979-88cb4eeccb64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:48.533396 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dc2e0dca-4610-413c-b979-88cb4eeccb64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:48.541214 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dc2e0dca-4610-413c-b979-88cb4eeccb64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.154296 Jun 22 17:01:48.541762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 178/377] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:48 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:49.557957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6c797244-506e-46e6-a53f-4489ca618276 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:49.558600 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6c797244-506e-46e6-a53f-4489ca618276 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:49.565541 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c797244-506e-46e6-a53f-4489ca618276 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:49.565988 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c797244-506e-46e6-a53f-4489ca618276 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:49.566741 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c797244-506e-46e6-a53f-4489ca618276 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:49.567163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c797244-506e-46e6-a53f-4489ca618276 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:49.701661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6c797244-506e-46e6-a53f-4489ca618276 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:49.709230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6c797244-506e-46e6-a53f-4489ca618276 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.155256 Jun 22 17:01:49.709789 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 200/378] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:49 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:50.726563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-16cd0bc2-2aa6-4b8d-bcfa-248b1548bcba tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:50.727184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-16cd0bc2-2aa6-4b8d-bcfa-248b1548bcba tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:50.733370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-16cd0bc2-2aa6-4b8d-bcfa-248b1548bcba tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:50.734019 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-16cd0bc2-2aa6-4b8d-bcfa-248b1548bcba tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:50.734737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-16cd0bc2-2aa6-4b8d-bcfa-248b1548bcba tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:50.735165 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-16cd0bc2-2aa6-4b8d-bcfa-248b1548bcba tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:50.865308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-16cd0bc2-2aa6-4b8d-bcfa-248b1548bcba tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:50.872687 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-16cd0bc2-2aa6-4b8d-bcfa-248b1548bcba tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.150172 Jun 22 17:01:50.873243 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 179/379] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:50 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:51.870333 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-d8b849dc-51e4-448d-adac-5e78810f644e req-0026e6df-beb2-4667-b0c5-24eccc2943db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a05301-1003-4be8-b8bd-824a620de060", "name": "network-vif-plugged", "status": "completed", "tag": "bc783111-9f8f-48c8-8d4f-6cc5af066635"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:01:51.884481 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-d8b849dc-51e4-448d-adac-5e78810f644e req-0026e6df-beb2-4667-b0c5-24eccc2943db service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:51.884481 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-d8b849dc-51e4-448d-adac-5e78810f644e req-0026e6df-beb2-4667-b0c5-24eccc2943db service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:51.889586 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6211fc80-2878-4c0d-ad0c-c8427fa48a13 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:51.890221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6211fc80-2878-4c0d-ad0c-c8427fa48a13 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:51.890858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-d8b849dc-51e4-448d-adac-5e78810f644e req-0026e6df-beb2-4667-b0c5-24eccc2943db service nova] Creating event network-vif-plugged:bc783111-9f8f-48c8-8d4f-6cc5af066635 for instance 97a05301-1003-4be8-b8bd-824a620de060 on hv-cinder-81045 Jun 22 17:01:51.896770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-d8b849dc-51e4-448d-adac-5e78810f644e req-0026e6df-beb2-4667-b0c5-24eccc2943db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029912 Jun 22 17:01:51.896945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6211fc80-2878-4c0d-ad0c-c8427fa48a13 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:51.897529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6211fc80-2878-4c0d-ad0c-c8427fa48a13 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:51.897646 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 201/380] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:01:51.898294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6211fc80-2878-4c0d-ad0c-c8427fa48a13 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:51.898795 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6211fc80-2878-4c0d-ad0c-c8427fa48a13 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:52.049790 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6211fc80-2878-4c0d-ad0c-c8427fa48a13 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:52.056924 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6211fc80-2878-4c0d-ad0c-c8427fa48a13 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.171248 Jun 22 17:01:52.057488 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 180/381] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:51 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:01:53.074372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bfaca468-477b-4a84-9c54-4ecda5f47e46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:53.075446 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bfaca468-477b-4a84-9c54-4ecda5f47e46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:53.082859 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bfaca468-477b-4a84-9c54-4ecda5f47e46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:53.083322 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bfaca468-477b-4a84-9c54-4ecda5f47e46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:53.084098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bfaca468-477b-4a84-9c54-4ecda5f47e46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:53.084569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bfaca468-477b-4a84-9c54-4ecda5f47e46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:53.248355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bfaca468-477b-4a84-9c54-4ecda5f47e46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:53.256665 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bfaca468-477b-4a84-9c54-4ecda5f47e46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.187055 Jun 22 17:01:53.257560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 202/382] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:53 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:54.273612 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fed763d5-8c88-4252-8e8a-6c37f670642a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:54.274263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fed763d5-8c88-4252-8e8a-6c37f670642a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:54.280874 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fed763d5-8c88-4252-8e8a-6c37f670642a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:54.281319 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fed763d5-8c88-4252-8e8a-6c37f670642a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:54.282161 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fed763d5-8c88-4252-8e8a-6c37f670642a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:54.282593 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fed763d5-8c88-4252-8e8a-6c37f670642a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:54.302026 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:54.414904 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fed763d5-8c88-4252-8e8a-6c37f670642a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:54.423999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fed763d5-8c88-4252-8e8a-6c37f670642a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.153763 Jun 22 17:01:54.433750 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 181/383] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:54 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:55.441707 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7210470d-58e7-400a-8012-a8accca7532a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:55.442218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7210470d-58e7-400a-8012-a8accca7532a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:55.444825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:55.449585 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7210470d-58e7-400a-8012-a8accca7532a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:55.450028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7210470d-58e7-400a-8012-a8accca7532a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:55.450783 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7210470d-58e7-400a-8012-a8accca7532a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:55.451250 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7210470d-58e7-400a-8012-a8accca7532a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:55.588480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7210470d-58e7-400a-8012-a8accca7532a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:55.596313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7210470d-58e7-400a-8012-a8accca7532a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.158819 Jun 22 17:01:55.596863 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 203/384] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:55 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:56.612724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6b866f75-3795-4700-ac4f-53de03bde574 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:56.613398 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6b866f75-3795-4700-ac4f-53de03bde574 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:56.619197 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b866f75-3795-4700-ac4f-53de03bde574 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:56.619649 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b866f75-3795-4700-ac4f-53de03bde574 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:56.620432 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b866f75-3795-4700-ac4f-53de03bde574 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:56.620872 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b866f75-3795-4700-ac4f-53de03bde574 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:56.750856 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6b866f75-3795-4700-ac4f-53de03bde574 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:56.758700 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6b866f75-3795-4700-ac4f-53de03bde574 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.150476 Jun 22 17:01:56.759256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 182/385] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:56 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:57.775138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e1c283a8-2ae2-4a5d-897d-0aea2ee38fdd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:57.775754 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e1c283a8-2ae2-4a5d-897d-0aea2ee38fdd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:57.783102 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e1c283a8-2ae2-4a5d-897d-0aea2ee38fdd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:57.783554 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e1c283a8-2ae2-4a5d-897d-0aea2ee38fdd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:57.784345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e1c283a8-2ae2-4a5d-897d-0aea2ee38fdd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:57.784781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e1c283a8-2ae2-4a5d-897d-0aea2ee38fdd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:57.911433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e1c283a8-2ae2-4a5d-897d-0aea2ee38fdd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:57.918711 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e1c283a8-2ae2-4a5d-897d-0aea2ee38fdd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1318 microversion: 2.1 time: 0.147408 Jun 22 17:01:57.919263 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 204/386] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:57 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:01:58.934698 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3baf8d9a-afcd-41fd-85c3-6b18f6c2e993 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:01:58.935311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3baf8d9a-afcd-41fd-85c3-6b18f6c2e993 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:01:58.945194 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3baf8d9a-afcd-41fd-85c3-6b18f6c2e993 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:58.945655 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3baf8d9a-afcd-41fd-85c3-6b18f6c2e993 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:58.946433 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3baf8d9a-afcd-41fd-85c3-6b18f6c2e993 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:01:58.946875 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3baf8d9a-afcd-41fd-85c3-6b18f6c2e993 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:01:59.097274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3baf8d9a-afcd-41fd-85c3-6b18f6c2e993 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:01:59.106027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3baf8d9a-afcd-41fd-85c3-6b18f6c2e993 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1507 microversion: 2.1 time: 0.174581 Jun 22 17:01:59.106727 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 183/387] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:01:58 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:02:46.681766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5bc6fc96-6fe5-4877-ae0d-f52934bcb8f3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "958af0f2-67e9-4ac4-8031-b618b4b89103", "device": "/dev/sdb"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:02:46.685086 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5bc6fc96-6fe5-4877-ae0d-f52934bcb8f3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:02:46.697926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:46.704213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=34 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:46.706290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5bc6fc96-6fe5-4877-ae0d-f52934bcb8f3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:02:46.706961 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5bc6fc96-6fe5-4877-ae0d-f52934bcb8f3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:02:46.708275 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5bc6fc96-6fe5-4877-ae0d-f52934bcb8f3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:02:46.709219 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5bc6fc96-6fe5-4877-ae0d-f52934bcb8f3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:02:47.726109 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5bc6fc96-6fe5-4877-ae0d-f52934bcb8f3 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "POST /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053802 Jun 22 17:02:47.727288 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 205/388] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:02:46 2022] POST /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060/os-volume_attachments => generated 194 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:02:54.070105 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:54.070994 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=14 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:54.311174 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-781cca0d-20e6-4853-b3c2-9b6ec605e994 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Action: 'create', calling method: .version_select at 0x7fe0a1126ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-537064178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjLMueaD4EZjghCA/X+hhqAcOXfKfoKuNtEr4aogj9pQyq3qb9EUiRvG3mpbU2c32F0+N0W1enCfPcwa/hTUlKbWPFzDiCxW5N2N8DXW67/SMHKfiAtvJO79c5rB1bWTw=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:02:54.325521 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-781cca0d-20e6-4853-b3c2-9b6ec605e994 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Getting quotas for project 053f13e36c374b3ca47073594406fe26. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:02:54.330552 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-781cca0d-20e6-4853-b3c2-9b6ec605e994 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Getting quotas for user 4bd8f30d0f834973a0e9f5d8dfc1a9ee and project 053f13e36c374b3ca47073594406fe26. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:02:54.450386 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-781cca0d-20e6-4853-b3c2-9b6ec605e994 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.384808 Jun 22 17:02:54.452602 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 184/389] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:02:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:03:11.804060 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3927e174-d0ae-4a70-bca9-76a6f872e273 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Action: 'create', calling method: .version_select at 0x7fe0a0fdf3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-31462629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7Ex4KR0sD5S4XvXnByYyaTIYnPnVBjYZ3tKVM6m0GqdxEsITV67iegiudioowsCA5Po7lt2ElS8pVsgyNRmS6D1acvdD/S2cBCIEhSNJ8g64gSsi0WrQm/+Z0Ix4msuQ=="}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:03:11.808897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:11.809573 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:11.820001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-3927e174-d0ae-4a70-bca9-76a6f872e273 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Getting quotas for project fb2f9e80471c4d6b93febc9534cb9be6. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:03:11.823811 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-3927e174-d0ae-4a70-bca9-76a6f872e273 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Getting quotas for user 9719a17bb03b43a09dcd7bf4f019c81c and project fb2f9e80471c4d6b93febc9534cb9be6. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:03:11.930269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3927e174-d0ae-4a70-bca9-76a6f872e273 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.130508 Jun 22 17:03:11.930862 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 206/390] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:03:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:03:11.979744 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-731774610", "imageRef": "1b026453-459f-450e-93be-e786f0f216ed", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-31462629", "networks": [{"uuid": "fd4609f6-4e90-4db1-b0a4-73ef957eadea"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:03:11.986689 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:12.032895 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] validate_networks() for [('fd4609f6-4e90-4db1-b0a4-73ef957eadea', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:03:12.410454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:03:12.410876 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:03:12.411343 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:03:12.411748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:03:12.412184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:03:12.420891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:12.421336 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:12.422128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:12.422570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:12.439059 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Getting quotas for project fb2f9e80471c4d6b93febc9534cb9be6. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:03:12.442918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Getting quotas for user 9719a17bb03b43a09dcd7bf4f019c81c and project fb2f9e80471c4d6b93febc9534cb9be6. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:03:12.454022 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:03:12.456172 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b026453-459f-450e-93be-e786f0f216ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:03:12.618659 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0218fd06-aa03-4ca2-ab4d-bd4cb9af07fe tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642766 Jun 22 17:03:12.619322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 185/391] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:03:12.630551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-26269d84-47e9-47a8-94eb-b4bf86593a4f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:12.631412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-26269d84-47e9-47a8-94eb-b4bf86593a4f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:12.696021 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-26269d84-47e9-47a8-94eb-b4bf86593a4f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:12.704700 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-26269d84-47e9-47a8-94eb-b4bf86593a4f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1256 microversion: 2.1 time: 0.078696 Jun 22 17:03:12.707961 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 207/392] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:12 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1256 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:13.722522 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2b8c0cf1-3f57-452c-a99b-c75b98568a22 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:13.723298 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2b8c0cf1-3f57-452c-a99b-c75b98568a22 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:13.779772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2b8c0cf1-3f57-452c-a99b-c75b98568a22 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:13.786728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2b8c0cf1-3f57-452c-a99b-c75b98568a22 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1256 microversion: 2.1 time: 0.068956 Jun 22 17:03:13.787275 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 186/393] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:13 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:14.804515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6c41a9d6-5578-4068-9d65-a4624ffaff91 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:14.805149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6c41a9d6-5578-4068-9d65-a4624ffaff91 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:14.811653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c41a9d6-5578-4068-9d65-a4624ffaff91 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:14.812079 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c41a9d6-5578-4068-9d65-a4624ffaff91 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:14.812846 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c41a9d6-5578-4068-9d65-a4624ffaff91 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:14.813272 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c41a9d6-5578-4068-9d65-a4624ffaff91 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:14.872792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6c41a9d6-5578-4068-9d65-a4624ffaff91 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:14.880072 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6c41a9d6-5578-4068-9d65-a4624ffaff91 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1260 microversion: 2.1 time: 0.079859 Jun 22 17:03:14.880650 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 208/394] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:14 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1260 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:15.896317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-73ff1690-2521-48a1-85d5-27c27b36d78e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:15.896932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-73ff1690-2521-48a1-85d5-27c27b36d78e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:15.903800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-73ff1690-2521-48a1-85d5-27c27b36d78e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:15.904280 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-73ff1690-2521-48a1-85d5-27c27b36d78e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:15.905052 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-73ff1690-2521-48a1-85d5-27c27b36d78e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:15.905486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-73ff1690-2521-48a1-85d5-27c27b36d78e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:15.964666 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-73ff1690-2521-48a1-85d5-27c27b36d78e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:15.972603 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-73ff1690-2521-48a1-85d5-27c27b36d78e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1260 microversion: 2.1 time: 0.080109 Jun 22 17:03:15.973145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 187/395] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:15 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1260 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:16.989571 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-89c65752-daaf-43a6-8616-befa346a9e64 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:16.990177 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-89c65752-daaf-43a6-8616-befa346a9e64 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:16.996562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-89c65752-daaf-43a6-8616-befa346a9e64 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:16.997002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-89c65752-daaf-43a6-8616-befa346a9e64 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:16.997747 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-89c65752-daaf-43a6-8616-befa346a9e64 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:16.998170 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-89c65752-daaf-43a6-8616-befa346a9e64 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:17.062064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-89c65752-daaf-43a6-8616-befa346a9e64 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:17.069503 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-89c65752-daaf-43a6-8616-befa346a9e64 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1260 microversion: 2.1 time: 0.084324 Jun 22 17:03:17.070066 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 209/396] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:16 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1260 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:18.090956 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-45e944e8-b4a6-4c79-b4d6-ec7a021cb751 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:18.091571 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-45e944e8-b4a6-4c79-b4d6-ec7a021cb751 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:18.097676 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45e944e8-b4a6-4c79-b4d6-ec7a021cb751 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:18.098133 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45e944e8-b4a6-4c79-b4d6-ec7a021cb751 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:18.098902 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45e944e8-b4a6-4c79-b4d6-ec7a021cb751 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:18.099341 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45e944e8-b4a6-4c79-b4d6-ec7a021cb751 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:18.159095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-45e944e8-b4a6-4c79-b4d6-ec7a021cb751 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:18.166342 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-45e944e8-b4a6-4c79-b4d6-ec7a021cb751 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1260 microversion: 2.1 time: 0.079381 Jun 22 17:03:18.166894 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 188/397] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:18 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1260 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:19.183493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fad2be2a-bcd6-487e-a62d-9f43fb76de17 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:19.184120 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fad2be2a-bcd6-487e-a62d-9f43fb76de17 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:19.190469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fad2be2a-bcd6-487e-a62d-9f43fb76de17 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:19.190915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fad2be2a-bcd6-487e-a62d-9f43fb76de17 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:19.191668 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fad2be2a-bcd6-487e-a62d-9f43fb76de17 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:19.192126 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fad2be2a-bcd6-487e-a62d-9f43fb76de17 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:19.251985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fad2be2a-bcd6-487e-a62d-9f43fb76de17 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:19.259654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fad2be2a-bcd6-487e-a62d-9f43fb76de17 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1308 microversion: 2.1 time: 0.080064 Jun 22 17:03:19.260233 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 210/398] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:19 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1308 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:20.277183 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5c9e12b7-20d9-4c18-8361-b9e031cedba0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:20.278639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5c9e12b7-20d9-4c18-8361-b9e031cedba0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:20.286834 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5c9e12b7-20d9-4c18-8361-b9e031cedba0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:20.286834 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5c9e12b7-20d9-4c18-8361-b9e031cedba0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:20.287419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5c9e12b7-20d9-4c18-8361-b9e031cedba0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:20.287877 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5c9e12b7-20d9-4c18-8361-b9e031cedba0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:20.477097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5c9e12b7-20d9-4c18-8361-b9e031cedba0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:20.487201 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5c9e12b7-20d9-4c18-8361-b9e031cedba0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.214280 Jun 22 17:03:20.487801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 189/399] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:20 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:21.504726 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6bd26fa6-dcb8-411a-adbf-fe4e06bca2f8 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:21.505360 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6bd26fa6-dcb8-411a-adbf-fe4e06bca2f8 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:21.511744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6bd26fa6-dcb8-411a-adbf-fe4e06bca2f8 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:21.512225 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6bd26fa6-dcb8-411a-adbf-fe4e06bca2f8 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:21.512985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6bd26fa6-dcb8-411a-adbf-fe4e06bca2f8 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:21.513419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6bd26fa6-dcb8-411a-adbf-fe4e06bca2f8 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:21.648307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6bd26fa6-dcb8-411a-adbf-fe4e06bca2f8 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:21.655696 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6bd26fa6-dcb8-411a-adbf-fe4e06bca2f8 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.155396 Jun 22 17:03:21.656535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 211/400] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:21 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:22.672932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8920f541-e638-42f3-b3bb-a03602ee3580 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:22.674787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8920f541-e638-42f3-b3bb-a03602ee3580 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:22.678177 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:22.687941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8920f541-e638-42f3-b3bb-a03602ee3580 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:22.688464 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8920f541-e638-42f3-b3bb-a03602ee3580 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:22.689264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8920f541-e638-42f3-b3bb-a03602ee3580 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:22.689749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8920f541-e638-42f3-b3bb-a03602ee3580 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:22.830151 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8920f541-e638-42f3-b3bb-a03602ee3580 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:22.838071 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8920f541-e638-42f3-b3bb-a03602ee3580 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.169530 Jun 22 17:03:22.838626 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 190/401] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:22 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:23.671011 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-91e9ab3c-9f2b-43dd-ad66-e7e641fe1b01 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:23.671648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-91e9ab3c-9f2b-43dd-ad66-e7e641fe1b01 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:23.674085 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:23.680191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-91e9ab3c-9f2b-43dd-ad66-e7e641fe1b01 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:23.683299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-91e9ab3c-9f2b-43dd-ad66-e7e641fe1b01 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:23.683299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-91e9ab3c-9f2b-43dd-ad66-e7e641fe1b01 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:23.683299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-91e9ab3c-9f2b-43dd-ad66-e7e641fe1b01 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:23.813276 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-91e9ab3c-9f2b-43dd-ad66-e7e641fe1b01 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lazy-loading 'services' on Instance uuid 97a05301-1003-4be8-b8bd-824a620de060 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:03:23.857371 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ec23493f-bb78-412e-a5d3-606a96a7c065 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:23.858445 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ec23493f-bb78-412e-a5d3-606a96a7c065 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:23.866208 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=8 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:23.872542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ec23493f-bb78-412e-a5d3-606a96a7c065 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:23.872542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ec23493f-bb78-412e-a5d3-606a96a7c065 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:23.872542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ec23493f-bb78-412e-a5d3-606a96a7c065 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:23.872542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ec23493f-bb78-412e-a5d3-606a96a7c065 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:24.022686 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ec23493f-bb78-412e-a5d3-606a96a7c065 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:24.030838 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ec23493f-bb78-412e-a5d3-606a96a7c065 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.178689 Jun 22 17:03:24.031711 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 191/402] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:23 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:24.077113 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-91e9ab3c-9f2b-43dd-ad66-e7e641fe1b01 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "DELETE /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060/os-volume_attachments/958af0f2-67e9-4ac4-8031-b618b4b89103" status: 202 len: 0 microversion: 2.1 time: 0.409973 Jun 22 17:03:24.078161 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 212/403] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:03:23 2022] DELETE /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060/os-volume_attachments/958af0f2-67e9-4ac4-8031-b618b4b89103 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:03:25.048000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-61c12791-5617-4a9f-8b55-af1365836e31 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:25.048563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-61c12791-5617-4a9f-8b55-af1365836e31 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:25.055292 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61c12791-5617-4a9f-8b55-af1365836e31 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:25.055740 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61c12791-5617-4a9f-8b55-af1365836e31 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:25.056554 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61c12791-5617-4a9f-8b55-af1365836e31 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:25.056990 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61c12791-5617-4a9f-8b55-af1365836e31 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:25.196369 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-61c12791-5617-4a9f-8b55-af1365836e31 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:25.207701 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-61c12791-5617-4a9f-8b55-af1365836e31 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.163512 Jun 22 17:03:25.210149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 192/404] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:25 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:26.226550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8112469e-41f8-48af-bad5-521e031f9352 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:26.228341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8112469e-41f8-48af-bad5-521e031f9352 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:26.235945 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8112469e-41f8-48af-bad5-521e031f9352 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:26.236495 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8112469e-41f8-48af-bad5-521e031f9352 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:26.237515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8112469e-41f8-48af-bad5-521e031f9352 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:26.238079 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8112469e-41f8-48af-bad5-521e031f9352 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:26.380025 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8112469e-41f8-48af-bad5-521e031f9352 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:26.387552 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8112469e-41f8-48af-bad5-521e031f9352 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.166207 Jun 22 17:03:26.388123 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 213/405] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:26 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:27.403389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d5d81f2d-76e5-42b7-b4db-4d7c3b5b1bbd tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:27.404011 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d5d81f2d-76e5-42b7-b4db-4d7c3b5b1bbd tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:27.410753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5d81f2d-76e5-42b7-b4db-4d7c3b5b1bbd tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:27.411195 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5d81f2d-76e5-42b7-b4db-4d7c3b5b1bbd tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:27.411939 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5d81f2d-76e5-42b7-b4db-4d7c3b5b1bbd tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:27.412390 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5d81f2d-76e5-42b7-b4db-4d7c3b5b1bbd tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:27.555790 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d5d81f2d-76e5-42b7-b4db-4d7c3b5b1bbd tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:27.563124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d5d81f2d-76e5-42b7-b4db-4d7c3b5b1bbd tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.163592 Jun 22 17:03:27.563679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 193/406] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:27 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:28.579082 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-17444a9e-9aea-4de3-90af-cc11d853aa00 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:28.579709 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-17444a9e-9aea-4de3-90af-cc11d853aa00 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:28.586287 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17444a9e-9aea-4de3-90af-cc11d853aa00 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:28.586736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17444a9e-9aea-4de3-90af-cc11d853aa00 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:28.587499 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17444a9e-9aea-4de3-90af-cc11d853aa00 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:28.587933 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17444a9e-9aea-4de3-90af-cc11d853aa00 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:28.725504 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-17444a9e-9aea-4de3-90af-cc11d853aa00 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:28.733341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-17444a9e-9aea-4de3-90af-cc11d853aa00 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.158086 Jun 22 17:03:28.735418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 214/407] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:28 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:29.750730 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a4f2257f-d28a-4c80-81b0-b1931fc91b34 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:29.751317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a4f2257f-d28a-4c80-81b0-b1931fc91b34 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:29.757681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4f2257f-d28a-4c80-81b0-b1931fc91b34 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:29.758130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4f2257f-d28a-4c80-81b0-b1931fc91b34 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:29.758892 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4f2257f-d28a-4c80-81b0-b1931fc91b34 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:29.759326 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4f2257f-d28a-4c80-81b0-b1931fc91b34 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:29.899312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a4f2257f-d28a-4c80-81b0-b1931fc91b34 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:29.907498 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a4f2257f-d28a-4c80-81b0-b1931fc91b34 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.160666 Jun 22 17:03:29.908274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 194/408] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:29 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:30.924187 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a1b3458b-7998-4adb-9be0-295ef5d7db13 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:30.924820 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a1b3458b-7998-4adb-9be0-295ef5d7db13 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:30.931891 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a1b3458b-7998-4adb-9be0-295ef5d7db13 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:30.932358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a1b3458b-7998-4adb-9be0-295ef5d7db13 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:30.933109 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a1b3458b-7998-4adb-9be0-295ef5d7db13 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:30.933536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a1b3458b-7998-4adb-9be0-295ef5d7db13 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:31.071920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a1b3458b-7998-4adb-9be0-295ef5d7db13 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:31.079532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a1b3458b-7998-4adb-9be0-295ef5d7db13 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.159219 Jun 22 17:03:31.080089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 215/409] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:30 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:32.096886 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8ccd527f-aaf0-477a-88fc-b7b570b5b997 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:32.097510 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8ccd527f-aaf0-477a-88fc-b7b570b5b997 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:32.103612 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8ccd527f-aaf0-477a-88fc-b7b570b5b997 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:32.104049 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8ccd527f-aaf0-477a-88fc-b7b570b5b997 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:32.104839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8ccd527f-aaf0-477a-88fc-b7b570b5b997 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:32.105267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8ccd527f-aaf0-477a-88fc-b7b570b5b997 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:32.234061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8ccd527f-aaf0-477a-88fc-b7b570b5b997 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:32.242420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8ccd527f-aaf0-477a-88fc-b7b570b5b997 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.149412 Jun 22 17:03:32.242986 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 195/410] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:32 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:32.762367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2120556420", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-537064178", "security_groups": [{"name": "tempest-secgroup-smoke-467656179"}], "networks": [{"uuid": "14a0abe6-7d10-4904-9884-66cad5515297"}], "block_device_mapping_v2": [{"uuid": "435adb99-f63b-4945-9e38-a6d377bcec07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:03:32.871887 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] validate_networks() for [('14a0abe6-7d10-4904-9884-66cad5515297', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:03:33.245291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:03:33.245291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:03:33.245291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:03:33.245291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:03:33.245291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:03:33.250973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:33.251416 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:33.252236 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:33.252774 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:33.259170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a5a832e6-1006-48cc-bc56-28f9771c889f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:33.259776 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a5a832e6-1006-48cc-bc56-28f9771c889f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:33.265624 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5a832e6-1006-48cc-bc56-28f9771c889f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:33.266069 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5a832e6-1006-48cc-bc56-28f9771c889f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:33.266816 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5a832e6-1006-48cc-bc56-28f9771c889f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:33.267242 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5a832e6-1006-48cc-bc56-28f9771c889f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:33.270016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Getting quotas for project 053f13e36c374b3ca47073594406fe26. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:03:33.274528 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Getting quotas for user 4bd8f30d0f834973a0e9f5d8dfc1a9ee and project 053f13e36c374b3ca47073594406fe26. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:03:33.330762 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:03:33.332945 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='435adb99-f63b-4945-9e38-a6d377bcec07',volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:03:33.397195 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a5a832e6-1006-48cc-bc56-28f9771c889f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:33.404559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a5a832e6-1006-48cc-bc56-28f9771c889f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.149715 Jun 22 17:03:33.405126 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 196/411] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:33 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:33.759551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f3c607d2-328e-4262-ae01-6ee26d3a4aee tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.000870 Jun 22 17:03:33.760207 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 216/412] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:03:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:03:33.769995 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-48c2e6f6-bbac-48ac-b1d3-33cc50d00fdc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:33.771348 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-48c2e6f6-bbac-48ac-b1d3-33cc50d00fdc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:33.828013 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-48c2e6f6-bbac-48ac-b1d3-33cc50d00fdc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:33.835249 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-48c2e6f6-bbac-48ac-b1d3-33cc50d00fdc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1088 microversion: 2.1 time: 0.069129 Jun 22 17:03:33.835804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 197/413] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:33 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:34.421911 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-19a2132a-c8d6-4360-a1bc-60d9d0271cee tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:34.422520 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-19a2132a-c8d6-4360-a1bc-60d9d0271cee tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:34.429679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19a2132a-c8d6-4360-a1bc-60d9d0271cee tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:34.430177 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19a2132a-c8d6-4360-a1bc-60d9d0271cee tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:34.430930 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19a2132a-c8d6-4360-a1bc-60d9d0271cee tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:34.431357 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19a2132a-c8d6-4360-a1bc-60d9d0271cee tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:34.561228 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-19a2132a-c8d6-4360-a1bc-60d9d0271cee tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:34.569226 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-19a2132a-c8d6-4360-a1bc-60d9d0271cee tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.151695 Jun 22 17:03:34.569860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 217/414] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:34 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:34.851935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-25742d7e-995c-440c-bc8f-2bf2b9815e0b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:34.852579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-25742d7e-995c-440c-bc8f-2bf2b9815e0b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:34.858532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25742d7e-995c-440c-bc8f-2bf2b9815e0b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:34.859024 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25742d7e-995c-440c-bc8f-2bf2b9815e0b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:34.859772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25742d7e-995c-440c-bc8f-2bf2b9815e0b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:34.860241 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25742d7e-995c-440c-bc8f-2bf2b9815e0b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:34.920874 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-25742d7e-995c-440c-bc8f-2bf2b9815e0b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:34.928754 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-25742d7e-995c-440c-bc8f-2bf2b9815e0b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1138 microversion: 2.1 time: 0.081086 Jun 22 17:03:34.929384 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 198/415] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:34 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:35.585591 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2133ff28-11dd-4f20-a1db-33f279b11796 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:35.586305 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2133ff28-11dd-4f20-a1db-33f279b11796 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:35.592733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2133ff28-11dd-4f20-a1db-33f279b11796 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:35.593176 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2133ff28-11dd-4f20-a1db-33f279b11796 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:35.594137 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2133ff28-11dd-4f20-a1db-33f279b11796 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:35.594569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2133ff28-11dd-4f20-a1db-33f279b11796 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:35.850205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2133ff28-11dd-4f20-a1db-33f279b11796 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:35.857667 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2133ff28-11dd-4f20-a1db-33f279b11796 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.276550 Jun 22 17:03:35.858323 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 218/416] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:35 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:35.946203 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ca21d8dd-dfaa-4eae-9c62-6f6822590959 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:35.952013 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ca21d8dd-dfaa-4eae-9c62-6f6822590959 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:35.952669 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ca21d8dd-dfaa-4eae-9c62-6f6822590959 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:35.953113 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ca21d8dd-dfaa-4eae-9c62-6f6822590959 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:35.953871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ca21d8dd-dfaa-4eae-9c62-6f6822590959 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:35.954299 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ca21d8dd-dfaa-4eae-9c62-6f6822590959 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:36.014284 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ca21d8dd-dfaa-4eae-9c62-6f6822590959 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:36.022303 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ca21d8dd-dfaa-4eae-9c62-6f6822590959 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1130 microversion: 2.1 time: 0.080504 Jun 22 17:03:36.022872 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 199/417] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:35 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1130 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:36.376744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-07093c84-77b4-4cf7-9b11-56a0463900e9 req-8e1a390b-557c-472b-ae35-c33091a3ae7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d468f375-b7cd-4cec-9a77-513abc2daba8", "tag": "3e7194d2-b6a9-470a-93b2-77d89d7aafdb"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:03:36.385505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-07093c84-77b4-4cf7-9b11-56a0463900e9 req-8e1a390b-557c-472b-ae35-c33091a3ae7e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:36.386209 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-07093c84-77b4-4cf7-9b11-56a0463900e9 req-8e1a390b-557c-472b-ae35-c33091a3ae7e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:36.399455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-07093c84-77b4-4cf7-9b11-56a0463900e9 req-8e1a390b-557c-472b-ae35-c33091a3ae7e service nova] Creating event network-changed:3e7194d2-b6a9-470a-93b2-77d89d7aafdb for instance d468f375-b7cd-4cec-9a77-513abc2daba8 on hv-cinder-81045 Jun 22 17:03:36.405573 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-07093c84-77b4-4cf7-9b11-56a0463900e9 req-8e1a390b-557c-472b-ae35-c33091a3ae7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032604 Jun 22 17:03:36.408658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 219/418] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:03:36.874907 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-31a1120a-0c37-462b-9d99-aa5369c76b4b tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:36.880864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-31a1120a-0c37-462b-9d99-aa5369c76b4b tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:36.882736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31a1120a-0c37-462b-9d99-aa5369c76b4b tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:36.883401 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31a1120a-0c37-462b-9d99-aa5369c76b4b tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:36.884208 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31a1120a-0c37-462b-9d99-aa5369c76b4b tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:36.884643 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31a1120a-0c37-462b-9d99-aa5369c76b4b tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:37.015257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-31a1120a-0c37-462b-9d99-aa5369c76b4b tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:37.023665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-31a1120a-0c37-462b-9d99-aa5369c76b4b tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.152639 Jun 22 17:03:37.024545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 200/419] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:36 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:37.040633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-dbf69a22-104e-4be7-8800-790e9cf11109 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:37.041425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-dbf69a22-104e-4be7-8800-790e9cf11109 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:37.047873 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dbf69a22-104e-4be7-8800-790e9cf11109 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:37.048890 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dbf69a22-104e-4be7-8800-790e9cf11109 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:37.049084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dbf69a22-104e-4be7-8800-790e9cf11109 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:37.049681 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dbf69a22-104e-4be7-8800-790e9cf11109 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:37.115951 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-dbf69a22-104e-4be7-8800-790e9cf11109 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:37.123441 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-dbf69a22-104e-4be7-8800-790e9cf11109 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1186 microversion: 2.1 time: 0.088402 Jun 22 17:03:37.124040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 220/420] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:37 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:37.931295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-46923440-ff54-4ac5-bd83-35bf12848e7d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:37.933467 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-46923440-ff54-4ac5-bd83-35bf12848e7d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:37.938043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-46923440-ff54-4ac5-bd83-35bf12848e7d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:37.938987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-46923440-ff54-4ac5-bd83-35bf12848e7d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:37.940552 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-46923440-ff54-4ac5-bd83-35bf12848e7d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:37.941046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-46923440-ff54-4ac5-bd83-35bf12848e7d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:37.966597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-46923440-ff54-4ac5-bd83-35bf12848e7d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:03:38.048986 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2295269e-7870-4745-bc91-b8428c312298 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:38.049606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2295269e-7870-4745-bc91-b8428c312298 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:38.062024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2295269e-7870-4745-bc91-b8428c312298 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:38.062473 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2295269e-7870-4745-bc91-b8428c312298 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:38.063439 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2295269e-7870-4745-bc91-b8428c312298 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:38.063906 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2295269e-7870-4745-bc91-b8428c312298 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:38.210993 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2295269e-7870-4745-bc91-b8428c312298 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:38.228393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2295269e-7870-4745-bc91-b8428c312298 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.181263 Jun 22 17:03:38.228393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 221/421] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:38 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:38.228393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-78bcee26-8cf8-485d-97fe-08245a559bf2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:38.228393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-78bcee26-8cf8-485d-97fe-08245a559bf2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:38.230755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78bcee26-8cf8-485d-97fe-08245a559bf2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:38.231203 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78bcee26-8cf8-485d-97fe-08245a559bf2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:38.231957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78bcee26-8cf8-485d-97fe-08245a559bf2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:38.232424 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78bcee26-8cf8-485d-97fe-08245a559bf2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:38.330971 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-46923440-ff54-4ac5-bd83-35bf12848e7d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "DELETE /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 204 len: 0 microversion: 2.1 time: 0.398319 Jun 22 17:03:38.330971 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 201/422] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:03:37 2022] DELETE /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:03:38.334559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d01accc8-7862-4351-81e2-8708a400368a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:38.335264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d01accc8-7862-4351-81e2-8708a400368a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:38.342762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d01accc8-7862-4351-81e2-8708a400368a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:38.343421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d01accc8-7862-4351-81e2-8708a400368a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:38.344253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d01accc8-7862-4351-81e2-8708a400368a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:38.344695 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d01accc8-7862-4351-81e2-8708a400368a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:38.363686 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:38.369994 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-78bcee26-8cf8-485d-97fe-08245a559bf2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:38.377686 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-78bcee26-8cf8-485d-97fe-08245a559bf2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1271 microversion: 2.1 time: 0.157303 Jun 22 17:03:38.378355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 222/423] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:38 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:38.473464 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d01accc8-7862-4351-81e2-8708a400368a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:38.481817 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d01accc8-7862-4351-81e2-8708a400368a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1513 microversion: 2.1 time: 0.152879 Jun 22 17:03:38.482302 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 202/424] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:38 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:39.236394 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5aa9e4a9-d42d-4dd6-8458-a909dddb65a4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:39.237002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5aa9e4a9-d42d-4dd6-8458-a909dddb65a4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:39.244089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5aa9e4a9-d42d-4dd6-8458-a909dddb65a4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:39.244574 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5aa9e4a9-d42d-4dd6-8458-a909dddb65a4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:39.245332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5aa9e4a9-d42d-4dd6-8458-a909dddb65a4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:39.245767 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5aa9e4a9-d42d-4dd6-8458-a909dddb65a4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:39.369782 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5aa9e4a9-d42d-4dd6-8458-a909dddb65a4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:39.377129 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5aa9e4a9-d42d-4dd6-8458-a909dddb65a4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.144609 Jun 22 17:03:39.377697 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 223/425] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:39 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:39.394467 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ff45fe76-4ff6-4807-84ac-c1631b516802 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:39.395067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ff45fe76-4ff6-4807-84ac-c1631b516802 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:39.401589 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ff45fe76-4ff6-4807-84ac-c1631b516802 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:39.402028 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ff45fe76-4ff6-4807-84ac-c1631b516802 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:39.402773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ff45fe76-4ff6-4807-84ac-c1631b516802 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:39.403197 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ff45fe76-4ff6-4807-84ac-c1631b516802 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:39.498730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f91d6a4b-6d31-4cac-ae24-cae033e6ff96 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:39.499338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f91d6a4b-6d31-4cac-ae24-cae033e6ff96 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:39.505694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f91d6a4b-6d31-4cac-ae24-cae033e6ff96 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:39.506142 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f91d6a4b-6d31-4cac-ae24-cae033e6ff96 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:39.506895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f91d6a4b-6d31-4cac-ae24-cae033e6ff96 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:39.507332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f91d6a4b-6d31-4cac-ae24-cae033e6ff96 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:39.530379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ff45fe76-4ff6-4807-84ac-c1631b516802 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:39.538119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ff45fe76-4ff6-4807-84ac-c1631b516802 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1271 microversion: 2.1 time: 0.147319 Jun 22 17:03:39.538682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 203/426] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:39 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:39.633949 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f91d6a4b-6d31-4cac-ae24-cae033e6ff96 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:39.641346 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f91d6a4b-6d31-4cac-ae24-cae033e6ff96 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1513 microversion: 2.1 time: 0.146374 Jun 22 17:03:39.641903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 224/427] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:39 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:40.393792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0976c3cd-b53e-42f6-91ec-270e620b32d6 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:40.394402 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0976c3cd-b53e-42f6-91ec-270e620b32d6 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:40.400370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0976c3cd-b53e-42f6-91ec-270e620b32d6 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:40.400955 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0976c3cd-b53e-42f6-91ec-270e620b32d6 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:40.401561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0976c3cd-b53e-42f6-91ec-270e620b32d6 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:40.401991 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0976c3cd-b53e-42f6-91ec-270e620b32d6 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:40.529033 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0976c3cd-b53e-42f6-91ec-270e620b32d6 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:40.536552 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0976c3cd-b53e-42f6-91ec-270e620b32d6 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.146649 Jun 22 17:03:40.537112 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 204/428] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:40 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:40.555103 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3e0e3e22-6ac4-418e-abe8-84c52acf0bfa tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:40.555708 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3e0e3e22-6ac4-418e-abe8-84c52acf0bfa tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:40.562068 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3e0e3e22-6ac4-418e-abe8-84c52acf0bfa tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:40.562507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3e0e3e22-6ac4-418e-abe8-84c52acf0bfa tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:40.563252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3e0e3e22-6ac4-418e-abe8-84c52acf0bfa tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:40.563678 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3e0e3e22-6ac4-418e-abe8-84c52acf0bfa tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:40.568258 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:40.658592 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f22ffbb2-3818-4df6-b643-6db1346f4245 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:40.659216 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f22ffbb2-3818-4df6-b643-6db1346f4245 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:40.665575 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f22ffbb2-3818-4df6-b643-6db1346f4245 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:40.666022 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f22ffbb2-3818-4df6-b643-6db1346f4245 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:40.666788 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f22ffbb2-3818-4df6-b643-6db1346f4245 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:40.667222 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f22ffbb2-3818-4df6-b643-6db1346f4245 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:40.705747 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3e0e3e22-6ac4-418e-abe8-84c52acf0bfa tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:40.726686 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3e0e3e22-6ac4-418e-abe8-84c52acf0bfa tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1271 microversion: 2.1 time: 0.175815 Jun 22 17:03:40.727589 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 225/429] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:40 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:40.815057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f22ffbb2-3818-4df6-b643-6db1346f4245 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:40.823268 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f22ffbb2-3818-4df6-b643-6db1346f4245 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1513 microversion: 2.1 time: 0.168768 Jun 22 17:03:40.823822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 205/430] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:40 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:41.553059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-132ceec9-36c0-4176-aa7e-f5bc5559899a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:41.553670 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-132ceec9-36c0-4176-aa7e-f5bc5559899a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:41.560073 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-132ceec9-36c0-4176-aa7e-f5bc5559899a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:41.560660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-132ceec9-36c0-4176-aa7e-f5bc5559899a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:41.561311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-132ceec9-36c0-4176-aa7e-f5bc5559899a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:41.561741 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-132ceec9-36c0-4176-aa7e-f5bc5559899a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:41.739092 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-d74203df-0714-4e2b-960f-6a7a127f79e6 req-cd337971-9152-439c-9cdf-bc457912fe94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c2b04e-ad8d-4468-9f45-91ce07db3fbe", "tag": "d4c66ab3-2ffd-425f-9e48-6a35b15335cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:03:41.747611 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-132ceec9-36c0-4176-aa7e-f5bc5559899a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:41.754607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d74203df-0714-4e2b-960f-6a7a127f79e6 req-cd337971-9152-439c-9cdf-bc457912fe94 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:41.755598 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d74203df-0714-4e2b-960f-6a7a127f79e6 req-cd337971-9152-439c-9cdf-bc457912fe94 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:41.757525 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-132ceec9-36c0-4176-aa7e-f5bc5559899a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.208299 Jun 22 17:03:41.758361 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 226/431] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:41 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:41.764808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-27f2cdcf-5dc4-4722-a7f2-98c074873dc5 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:41.765780 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-27f2cdcf-5dc4-4722-a7f2-98c074873dc5 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:41.771349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-d74203df-0714-4e2b-960f-6a7a127f79e6 req-cd337971-9152-439c-9cdf-bc457912fe94 service nova] Creating event network-changed:d4c66ab3-2ffd-425f-9e48-6a35b15335cd for instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe on hv-cinder-81045 Jun 22 17:03:41.773581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-27f2cdcf-5dc4-4722-a7f2-98c074873dc5 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:41.775503 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-27f2cdcf-5dc4-4722-a7f2-98c074873dc5 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:41.775634 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-27f2cdcf-5dc4-4722-a7f2-98c074873dc5 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:41.776036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-27f2cdcf-5dc4-4722-a7f2-98c074873dc5 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:41.776933 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-d74203df-0714-4e2b-960f-6a7a127f79e6 req-cd337971-9152-439c-9cdf-bc457912fe94 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041885 Jun 22 17:03:41.777773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 206/432] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:03:41.842848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-935bf30a-05e9-4a28-baa0-4411cf38dcad tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:41.843558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-935bf30a-05e9-4a28-baa0-4411cf38dcad tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:41.850203 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-935bf30a-05e9-4a28-baa0-4411cf38dcad tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:41.850770 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-935bf30a-05e9-4a28-baa0-4411cf38dcad tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:41.851551 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-935bf30a-05e9-4a28-baa0-4411cf38dcad tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:41.851983 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-935bf30a-05e9-4a28-baa0-4411cf38dcad tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:41.920564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-27f2cdcf-5dc4-4722-a7f2-98c074873dc5 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:41.928571 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-27f2cdcf-5dc4-4722-a7f2-98c074873dc5 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1271 microversion: 2.1 time: 0.168964 Jun 22 17:03:41.929519 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 227/433] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:41 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:41.996437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-935bf30a-05e9-4a28-baa0-4411cf38dcad tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:42.003970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-935bf30a-05e9-4a28-baa0-4411cf38dcad tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1513 microversion: 2.1 time: 0.166542 Jun 22 17:03:42.014959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 207/434] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:41 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:42.775089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-53be8d29-8434-4e73-8ddf-a904d94d3792 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:42.775939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-53be8d29-8434-4e73-8ddf-a904d94d3792 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:42.779227 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:42.783366 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-53be8d29-8434-4e73-8ddf-a904d94d3792 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:42.783815 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-53be8d29-8434-4e73-8ddf-a904d94d3792 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:42.784824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-53be8d29-8434-4e73-8ddf-a904d94d3792 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:42.785258 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-53be8d29-8434-4e73-8ddf-a904d94d3792 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:42.945645 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6b515eba-dae7-4442-8223-fafb1afe73d8 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:42.946260 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6b515eba-dae7-4442-8223-fafb1afe73d8 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:42.948302 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:42.948888 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-53be8d29-8434-4e73-8ddf-a904d94d3792 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:42.952954 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b515eba-dae7-4442-8223-fafb1afe73d8 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:42.953398 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b515eba-dae7-4442-8223-fafb1afe73d8 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:42.954166 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b515eba-dae7-4442-8223-fafb1afe73d8 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:42.954597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b515eba-dae7-4442-8223-fafb1afe73d8 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:42.956544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-53be8d29-8434-4e73-8ddf-a904d94d3792 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.185869 Jun 22 17:03:42.957182 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 228/435] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:42 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:43.022243 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-870f4e10-ab75-40b6-b58c-bab3f88cc137 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:43.025703 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-870f4e10-ab75-40b6-b58c-bab3f88cc137 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:43.031158 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-870f4e10-ab75-40b6-b58c-bab3f88cc137 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:43.031611 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-870f4e10-ab75-40b6-b58c-bab3f88cc137 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:43.032682 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-870f4e10-ab75-40b6-b58c-bab3f88cc137 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:43.033274 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-870f4e10-ab75-40b6-b58c-bab3f88cc137 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:43.144749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6b515eba-dae7-4442-8223-fafb1afe73d8 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:43.152880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6b515eba-dae7-4442-8223-fafb1afe73d8 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.211611 Jun 22 17:03:43.154198 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 208/436] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:42 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:43.261387 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:43.267673 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-870f4e10-ab75-40b6-b58c-bab3f88cc137 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:43.277748 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-870f4e10-ab75-40b6-b58c-bab3f88cc137 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1513 microversion: 2.1 time: 0.260264 Jun 22 17:03:43.278255 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 229/437] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:43 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:43.611590 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-e4a0ccb1-8ba9-4b4e-bfbc-fc3c0991e97d req-e94af642-d660-4063-a904-396127f9e9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a05301-1003-4be8-b8bd-824a620de060", "name": "network-vif-deleted", "tag": "bc783111-9f8f-48c8-8d4f-6cc5af066635"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:03:43.620356 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-e4a0ccb1-8ba9-4b4e-bfbc-fc3c0991e97d req-e94af642-d660-4063-a904-396127f9e9de service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:43.620787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-e4a0ccb1-8ba9-4b4e-bfbc-fc3c0991e97d req-e94af642-d660-4063-a904-396127f9e9de service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:43.631370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-e4a0ccb1-8ba9-4b4e-bfbc-fc3c0991e97d req-e94af642-d660-4063-a904-396127f9e9de service nova] Creating event network-vif-deleted:bc783111-9f8f-48c8-8d4f-6cc5af066635 for instance 97a05301-1003-4be8-b8bd-824a620de060 on hv-cinder-81045 Jun 22 17:03:43.636434 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-e4a0ccb1-8ba9-4b4e-bfbc-fc3c0991e97d req-e94af642-d660-4063-a904-396127f9e9de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028546 Jun 22 17:03:43.637002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 209/438] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:03:43.974322 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fe96a059-fd6a-4914-8f83-18adf1b00c9e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:43.974932 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fe96a059-fd6a-4914-8f83-18adf1b00c9e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:43.977153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:43.982567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe96a059-fd6a-4914-8f83-18adf1b00c9e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:43.983018 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe96a059-fd6a-4914-8f83-18adf1b00c9e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:43.983776 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe96a059-fd6a-4914-8f83-18adf1b00c9e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:43.984241 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe96a059-fd6a-4914-8f83-18adf1b00c9e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:44.117013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fe96a059-fd6a-4914-8f83-18adf1b00c9e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:44.124410 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fe96a059-fd6a-4914-8f83-18adf1b00c9e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.154432 Jun 22 17:03:44.124963 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 230/439] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:43 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:44.171349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bddc3888-bfbb-43bd-9cea-2c36ebf031b0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:44.172285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bddc3888-bfbb-43bd-9cea-2c36ebf031b0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:44.175662 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:44.179959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bddc3888-bfbb-43bd-9cea-2c36ebf031b0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:44.180608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bddc3888-bfbb-43bd-9cea-2c36ebf031b0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:44.181421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bddc3888-bfbb-43bd-9cea-2c36ebf031b0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:44.181851 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bddc3888-bfbb-43bd-9cea-2c36ebf031b0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:44.294807 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-659c8c42-33da-45d1-a79b-6980f7b29b17 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:44.295408 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-659c8c42-33da-45d1-a79b-6980f7b29b17 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:44.306759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-659c8c42-33da-45d1-a79b-6980f7b29b17 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:44.311239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-659c8c42-33da-45d1-a79b-6980f7b29b17 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:44.311239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-659c8c42-33da-45d1-a79b-6980f7b29b17 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:44.311239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-659c8c42-33da-45d1-a79b-6980f7b29b17 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:44.314823 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bddc3888-bfbb-43bd-9cea-2c36ebf031b0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:44.323404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bddc3888-bfbb-43bd-9cea-2c36ebf031b0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.156736 Jun 22 17:03:44.324214 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 210/440] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:44 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:44.381067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-659c8c42-33da-45d1-a79b-6980f7b29b17 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:44.388803 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-659c8c42-33da-45d1-a79b-6980f7b29b17 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1471 microversion: 2.1 time: 0.097950 Jun 22 17:03:44.389367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 231/441] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:44 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1471 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:44.420593 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-2a23ce42-95fa-4e54-aaf7-0c3394beb57d req-5ac6cebe-bee5-4df6-b788-df2a65dd62ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d468f375-b7cd-4cec-9a77-513abc2daba8", "name": "network-vif-plugged", "status": "completed", "tag": "3e7194d2-b6a9-470a-93b2-77d89d7aafdb"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:03:44.429332 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2a23ce42-95fa-4e54-aaf7-0c3394beb57d req-5ac6cebe-bee5-4df6-b788-df2a65dd62ad service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:44.429779 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2a23ce42-95fa-4e54-aaf7-0c3394beb57d req-5ac6cebe-bee5-4df6-b788-df2a65dd62ad service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:44.440595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-2a23ce42-95fa-4e54-aaf7-0c3394beb57d req-5ac6cebe-bee5-4df6-b788-df2a65dd62ad service nova] Creating event network-vif-plugged:3e7194d2-b6a9-470a-93b2-77d89d7aafdb for instance d468f375-b7cd-4cec-9a77-513abc2daba8 on hv-cinder-81045 Jun 22 17:03:44.445615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-2a23ce42-95fa-4e54-aaf7-0c3394beb57d req-5ac6cebe-bee5-4df6-b788-df2a65dd62ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028630 Jun 22 17:03:44.447821 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 211/442] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:03:45.141180 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5d2589e8-214f-4023-9fb5-c01e94a7f367 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:45.141786 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5d2589e8-214f-4023-9fb5-c01e94a7f367 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:45.148904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d2589e8-214f-4023-9fb5-c01e94a7f367 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:45.149352 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d2589e8-214f-4023-9fb5-c01e94a7f367 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:45.150102 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d2589e8-214f-4023-9fb5-c01e94a7f367 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:45.150531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d2589e8-214f-4023-9fb5-c01e94a7f367 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:45.276872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5d2589e8-214f-4023-9fb5-c01e94a7f367 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:45.284461 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5d2589e8-214f-4023-9fb5-c01e94a7f367 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.147250 Jun 22 17:03:45.286138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 232/443] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:45 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:45.341007 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7248465c-1e26-469b-b901-30b672f02331 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:45.341703 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7248465c-1e26-469b-b901-30b672f02331 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:45.348839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7248465c-1e26-469b-b901-30b672f02331 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:45.349328 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7248465c-1e26-469b-b901-30b672f02331 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:45.350095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7248465c-1e26-469b-b901-30b672f02331 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:45.350532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7248465c-1e26-469b-b901-30b672f02331 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:45.405805 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:45.406525 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:45.412773 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:45.413218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:45.413981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:45.414410 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:45.444861 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:45.445307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:45.445753 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lazy-loading 'fault' on Instance uuid 97a05301-1003-4be8-b8bd-824a620de060 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:03:45.481535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7248465c-1e26-469b-b901-30b672f02331 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:45.489171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7248465c-1e26-469b-b901-30b672f02331 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.152344 Jun 22 17:03:45.489592 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:45.492987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 212/444] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:45 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:45.497353 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-17ff8288-d737-436f-a7dc-bdbb92c20e52 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1308 microversion: 2.1 time: 0.095385 Jun 22 17:03:45.497907 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 233/445] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:45 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:46.301383 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7f5ea7fc-21b9-40b6-b53d-ce74f9b9534d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:46.301914 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7f5ea7fc-21b9-40b6-b53d-ce74f9b9534d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:46.307864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7f5ea7fc-21b9-40b6-b53d-ce74f9b9534d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:46.308345 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7f5ea7fc-21b9-40b6-b53d-ce74f9b9534d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:46.309100 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7f5ea7fc-21b9-40b6-b53d-ce74f9b9534d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:46.309557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7f5ea7fc-21b9-40b6-b53d-ce74f9b9534d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:46.439118 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7f5ea7fc-21b9-40b6-b53d-ce74f9b9534d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:46.446645 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7f5ea7fc-21b9-40b6-b53d-ce74f9b9534d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1356 microversion: 2.1 time: 0.149101 Jun 22 17:03:46.447201 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 213/446] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:46 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:46.505864 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-42d20485-d115-4751-add0-1ffd82cb6e4a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:46.506488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-42d20485-d115-4751-add0-1ffd82cb6e4a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:46.512929 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-42d20485-d115-4751-add0-1ffd82cb6e4a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:46.513385 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-42d20485-d115-4751-add0-1ffd82cb6e4a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:46.514155 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-42d20485-d115-4751-add0-1ffd82cb6e4a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:46.515887 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-42d20485-d115-4751-add0-1ffd82cb6e4a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:46.521730 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:46.522470 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:46.528714 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:46.529161 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:46.530171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:46.530344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:46.566152 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:46.566514 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:46.567997 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lazy-loading 'fault' on Instance uuid 97a05301-1003-4be8-b8bd-824a620de060 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:03:46.615252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:46.622663 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b92853a1-fe9c-4d09-a12a-6af4817a0284 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 200 len: 1308 microversion: 2.1 time: 0.105475 Jun 22 17:03:46.623220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 214/447] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:46 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:46.651753 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-42d20485-d115-4751-add0-1ffd82cb6e4a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:46.659476 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-42d20485-d115-4751-add0-1ffd82cb6e4a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.157533 Jun 22 17:03:46.660031 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 234/448] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:46 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:47.462871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ab99a94e-aad6-47d2-840f-bd50dc7de44f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:47.463492 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ab99a94e-aad6-47d2-840f-bd50dc7de44f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:47.469439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ab99a94e-aad6-47d2-840f-bd50dc7de44f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.469888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ab99a94e-aad6-47d2-840f-bd50dc7de44f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.470643 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ab99a94e-aad6-47d2-840f-bd50dc7de44f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.471075 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ab99a94e-aad6-47d2-840f-bd50dc7de44f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.595276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ab99a94e-aad6-47d2-840f-bd50dc7de44f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:47.603077 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ab99a94e-aad6-47d2-840f-bd50dc7de44f tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1546 microversion: 2.1 time: 0.143967 Jun 22 17:03:47.603638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 215/449] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:47 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1546 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:47.619879 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ec491367-fd4e-429b-866a-84664fdb5df7 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:47.620545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ec491367-fd4e-429b-866a-84664fdb5df7 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:47.627096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ec491367-fd4e-429b-866a-84664fdb5df7 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.627531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ec491367-fd4e-429b-866a-84664fdb5df7 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.628360 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ec491367-fd4e-429b-866a-84664fdb5df7 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.628802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ec491367-fd4e-429b-866a-84664fdb5df7 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.639878 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:47.640519 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 97a05301-1003-4be8-b8bd-824a620de060] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:47.646602 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.647049 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.647808 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.648479 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.662448 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] HTTP exception thrown: Instance 97a05301-1003-4be8-b8bd-824a620de060 could not be found. Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Request method failure captured: Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 HTTP/1.1 Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0rcMEkk8Z_Qv_JLdDY-pnbkPT-A2oI-SKUc-wtn-RqxvzUNZUr2xYe0RKnPb9TnlOCTdC_7T0NwroyHJg-k6tqvXc3NM6RKrIRzMphrJ8fcZkVfVvCDD9IxP_ueYBr4oAcWK1wUx79RSfRTsZUtI_ZOFjsghjlGZdFdhISkE0yruYU Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: d1b55c4096154398912c80d62bc2430b Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1017384273 Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:03:47.664086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d1b55c4096154398912c80d62bc2430b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d1b55c4096154398912c80d62bc2430b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d1b55c4096154398912c80d62bc2430b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d1b55c4096154398912c80d62bc2430b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesSnapshotTestJSON-1017384273 Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: d1b55c4096154398912c80d62bc2430b Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1017384273 Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesSnapshotTestJSON-1017384273-project Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: eaa62b68f6704652b48d08fcba5e4798 Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesSnapshotTestJSON-1017384273-project Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 97a05301-1003-4be8-b8bd-824a620de060 could not be found. Jun 22 17:03:47.665517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '97a05301-1003-4be8-b8bd-824a620de060'} Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a05301-1003-4be8-b8bd-824a620de060 could not be found. Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:03:47.666344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a05301-1003-4be8-b8bd-824a620de060 could not be found. Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a05301-1003-4be8-b8bd-824a620de060 could not be found. Jun 22 17:03:47.667787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:03:47.669452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Returning 404 to user: Instance 97a05301-1003-4be8-b8bd-824a620de060 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:03:47.669452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-96a56262-1551-44e5-9177-28c3845ca313 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060" status: 404 len: 111 microversion: 2.1 time: 0.029393 Jun 22 17:03:47.669452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 216/450] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:47 2022] GET /compute/v2.1/servers/97a05301-1003-4be8-b8bd-824a620de060 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:03:47.680184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-26ddd3ac-3812-42dd-ae0a-224ed2d0deab tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:47.680184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-26ddd3ac-3812-42dd-ae0a-224ed2d0deab tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:47.684426 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26ddd3ac-3812-42dd-ae0a-224ed2d0deab tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.684941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26ddd3ac-3812-42dd-ae0a-224ed2d0deab tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.685935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26ddd3ac-3812-42dd-ae0a-224ed2d0deab tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.686343 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26ddd3ac-3812-42dd-ae0a-224ed2d0deab tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.764371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ec491367-fd4e-429b-866a-84664fdb5df7 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:47.771584 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ec491367-fd4e-429b-866a-84664fdb5df7 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1546 microversion: 2.1 time: 0.155490 Jun 22 17:03:47.772169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 235/451] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:47 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:47.788115 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:47.791687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:47.792467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Searching by: {'deleted': False, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6'} {{(pid=118471) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 17:03:47.799195 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.799635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.800466 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:47.800896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:47.822724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-26ddd3ac-3812-42dd-ae0a-224ed2d0deab tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:47.830589 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-26ddd3ac-3812-42dd-ae0a-224ed2d0deab tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.158478 Jun 22 17:03:47.831150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 217/452] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:47 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:47.892168 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.multi_cell_list [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118471) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 17:03:47.985979 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a8665564-7ba5-42aa-a32d-fa9a953e1f96 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201941 Jun 22 17:03:47.986489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 236/453] 10.222.0.18 () {58 vars in 1124 bytes} [Wed Jun 22 17:03:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:03:47.996512 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7e293405-64c7-4ebc-b5e8-a8b4208ec4b9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:47.997117 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7e293405-64c7-4ebc-b5e8-a8b4208ec4b9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:48.003158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e293405-64c7-4ebc-b5e8-a8b4208ec4b9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:48.003604 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e293405-64c7-4ebc-b5e8-a8b4208ec4b9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:48.004388 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e293405-64c7-4ebc-b5e8-a8b4208ec4b9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:48.004828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e293405-64c7-4ebc-b5e8-a8b4208ec4b9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:48.145314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7e293405-64c7-4ebc-b5e8-a8b4208ec4b9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:48.153364 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7e293405-64c7-4ebc-b5e8-a8b4208ec4b9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1546 microversion: 2.1 time: 0.160597 Jun 22 17:03:48.153919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 218/454] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:47 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:48.847932 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1deb141b-ec4e-4d0d-8ac6-7339b41ed4fd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:48.848608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1deb141b-ec4e-4d0d-8ac6-7339b41ed4fd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:48.854984 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1deb141b-ec4e-4d0d-8ac6-7339b41ed4fd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:48.855425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1deb141b-ec4e-4d0d-8ac6-7339b41ed4fd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:48.856199 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1deb141b-ec4e-4d0d-8ac6-7339b41ed4fd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:48.856623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1deb141b-ec4e-4d0d-8ac6-7339b41ed4fd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:49.085841 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1deb141b-ec4e-4d0d-8ac6-7339b41ed4fd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:49.093419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1deb141b-ec4e-4d0d-8ac6-7339b41ed4fd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.249386 Jun 22 17:03:49.093970 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 237/455] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:48 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:50.110474 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b58d72fa-d3a3-4f5a-bef2-824864eddccf tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:50.111084 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b58d72fa-d3a3-4f5a-bef2-824864eddccf tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:50.117077 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b58d72fa-d3a3-4f5a-bef2-824864eddccf tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:50.117525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b58d72fa-d3a3-4f5a-bef2-824864eddccf tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:50.118283 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b58d72fa-d3a3-4f5a-bef2-824864eddccf tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:50.118715 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b58d72fa-d3a3-4f5a-bef2-824864eddccf tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:50.298267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b58d72fa-d3a3-4f5a-bef2-824864eddccf tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:50.305508 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b58d72fa-d3a3-4f5a-bef2-824864eddccf tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.198936 Jun 22 17:03:50.306057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 219/456] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:50 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:51.322638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c5d5f535-ecf6-41c5-8c20-32afcf38a011 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:51.323299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c5d5f535-ecf6-41c5-8c20-32afcf38a011 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:51.329765 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c5d5f535-ecf6-41c5-8c20-32afcf38a011 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:51.330277 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c5d5f535-ecf6-41c5-8c20-32afcf38a011 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:51.334373 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c5d5f535-ecf6-41c5-8c20-32afcf38a011 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:51.334373 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c5d5f535-ecf6-41c5-8c20-32afcf38a011 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:51.474727 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c5d5f535-ecf6-41c5-8c20-32afcf38a011 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:51.482045 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c5d5f535-ecf6-41c5-8c20-32afcf38a011 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.163200 Jun 22 17:03:51.482600 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 238/457] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:51 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:52.498569 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dc3925b5-844d-4123-8a8e-dfbb3fed0f5a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:52.499161 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dc3925b5-844d-4123-8a8e-dfbb3fed0f5a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:52.505753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dc3925b5-844d-4123-8a8e-dfbb3fed0f5a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:52.506196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dc3925b5-844d-4123-8a8e-dfbb3fed0f5a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:52.506955 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dc3925b5-844d-4123-8a8e-dfbb3fed0f5a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:52.507386 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dc3925b5-844d-4123-8a8e-dfbb3fed0f5a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:52.636928 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dc3925b5-844d-4123-8a8e-dfbb3fed0f5a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:52.644245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dc3925b5-844d-4123-8a8e-dfbb3fed0f5a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.149519 Jun 22 17:03:52.644801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 220/458] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:52 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:53.660141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-64f5c5f9-c95e-4acb-a35b-ae06b45744c1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:53.660755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-64f5c5f9-c95e-4acb-a35b-ae06b45744c1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:53.667134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-64f5c5f9-c95e-4acb-a35b-ae06b45744c1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:53.673242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-64f5c5f9-c95e-4acb-a35b-ae06b45744c1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:53.673242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-64f5c5f9-c95e-4acb-a35b-ae06b45744c1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:53.673242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-64f5c5f9-c95e-4acb-a35b-ae06b45744c1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:53.796395 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-64f5c5f9-c95e-4acb-a35b-ae06b45744c1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:53.804316 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-64f5c5f9-c95e-4acb-a35b-ae06b45744c1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.148213 Jun 22 17:03:53.804873 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 239/459] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:53 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:54.193811 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-77e99a22-9fc2-4831-a2e5-f08283d2b550 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:03:54.195027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-77e99a22-9fc2-4831-a2e5-f08283d2b550 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:54.201027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-77e99a22-9fc2-4831-a2e5-f08283d2b550 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:54.201469 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-77e99a22-9fc2-4831-a2e5-f08283d2b550 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:54.202218 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-77e99a22-9fc2-4831-a2e5-f08283d2b550 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:54.202647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-77e99a22-9fc2-4831-a2e5-f08283d2b550 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:54.218727 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:54.820925 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cb710b1a-e984-44da-8fd2-0c73aa414379 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:54.821526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-cb710b1a-e984-44da-8fd2-0c73aa414379 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:54.828222 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cb710b1a-e984-44da-8fd2-0c73aa414379 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:54.828665 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cb710b1a-e984-44da-8fd2-0c73aa414379 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:54.829444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cb710b1a-e984-44da-8fd2-0c73aa414379 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:54.829851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cb710b1a-e984-44da-8fd2-0c73aa414379 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:54.904879 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-77e99a22-9fc2-4831-a2e5-f08283d2b550 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "POST /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714806 Jun 22 17:03:54.905699 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 221/460] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:03:54 2022] POST /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:03:54.978314 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cb710b1a-e984-44da-8fd2-0c73aa414379 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:54.985965 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cb710b1a-e984-44da-8fd2-0c73aa414379 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.168810 Jun 22 17:03:54.986521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 240/461] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:54 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:03:56.003408 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dac9ef60-c22c-49dd-9b54-84c1273f837a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:56.004120 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dac9ef60-c22c-49dd-9b54-84c1273f837a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:56.010995 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dac9ef60-c22c-49dd-9b54-84c1273f837a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:56.011444 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dac9ef60-c22c-49dd-9b54-84c1273f837a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:56.012234 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dac9ef60-c22c-49dd-9b54-84c1273f837a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:56.012662 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dac9ef60-c22c-49dd-9b54-84c1273f837a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:56.144445 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dac9ef60-c22c-49dd-9b54-84c1273f837a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:56.152038 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dac9ef60-c22c-49dd-9b54-84c1273f837a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.153255 Jun 22 17:03:56.152614 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 222/462] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:55 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:57.168887 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ad513084-8a50-46a0-b3d1-4e85d9f114f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:57.169493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ad513084-8a50-46a0-b3d1-4e85d9f114f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:57.175851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad513084-8a50-46a0-b3d1-4e85d9f114f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:57.176327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad513084-8a50-46a0-b3d1-4e85d9f114f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:57.177074 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad513084-8a50-46a0-b3d1-4e85d9f114f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:57.177545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad513084-8a50-46a0-b3d1-4e85d9f114f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:57.181401 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:57.304240 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ad513084-8a50-46a0-b3d1-4e85d9f114f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:57.311512 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ad513084-8a50-46a0-b3d1-4e85d9f114f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.146452 Jun 22 17:03:57.312063 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 241/463] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:57 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:58.329020 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fff3f7ab-481c-4cd0-ad08-a2ba959c8210 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:58.329533 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fff3f7ab-481c-4cd0-ad08-a2ba959c8210 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:58.336730 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fff3f7ab-481c-4cd0-ad08-a2ba959c8210 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:58.337178 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fff3f7ab-481c-4cd0-ad08-a2ba959c8210 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:58.337931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fff3f7ab-481c-4cd0-ad08-a2ba959c8210 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:58.338402 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fff3f7ab-481c-4cd0-ad08-a2ba959c8210 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:58.481360 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fff3f7ab-481c-4cd0-ad08-a2ba959c8210 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:58.488718 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fff3f7ab-481c-4cd0-ad08-a2ba959c8210 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.163773 Jun 22 17:03:58.489267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 223/464] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:58 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:03:59.505008 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-051cef4d-b50f-4e0a-9662-6ce0ce8a5142 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:03:59.505644 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-051cef4d-b50f-4e0a-9662-6ce0ce8a5142 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:03:59.507454 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:59.512720 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-051cef4d-b50f-4e0a-9662-6ce0ce8a5142 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:59.513170 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-051cef4d-b50f-4e0a-9662-6ce0ce8a5142 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:59.513930 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-051cef4d-b50f-4e0a-9662-6ce0ce8a5142 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:03:59.514364 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-051cef4d-b50f-4e0a-9662-6ce0ce8a5142 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:03:59.677106 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-051cef4d-b50f-4e0a-9662-6ce0ce8a5142 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:03:59.686367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-051cef4d-b50f-4e0a-9662-6ce0ce8a5142 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.185089 Jun 22 17:03:59.686943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 242/465] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:03:59 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:00.187363 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1137947810", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "networks": [{"uuid": "430ac38b-6632-4da8-86db-9d079cd300c2"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:00.243707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] validate_networks() for [('430ac38b-6632-4da8-86db-9d079cd300c2', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:04:00.627785 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:04:00.628258 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:04:00.628735 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:04:00.629148 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:04:00.629562 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:04:00.638905 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:00.639358 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:00.640189 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:00.640631 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:00.656853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Getting quotas for project d1b55c4096154398912c80d62bc2430b. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:04:00.661121 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Getting quotas for user eaa62b68f6704652b48d08fcba5e4798 and project d1b55c4096154398912c80d62bc2430b. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:04:00.672580 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:04:00.675727 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:04:00.702910 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9e1c8af6-c6e1-4ed2-976c-d6a0c45a6b5d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:00.707801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9e1c8af6-c6e1-4ed2-976c-d6a0c45a6b5d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:00.710799 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e1c8af6-c6e1-4ed2-976c-d6a0c45a6b5d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:00.711247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e1c8af6-c6e1-4ed2-976c-d6a0c45a6b5d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:00.712009 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e1c8af6-c6e1-4ed2-976c-d6a0c45a6b5d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:00.712581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e1c8af6-c6e1-4ed2-976c-d6a0c45a6b5d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:00.828044 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aa2b47df-662f-44b4-8030-40251acdd10b tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644874 Jun 22 17:04:00.828943 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 224/466] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:04:00.838386 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6e15adb4-854e-4db9-96a1-ddcdf3ade7a0 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:00.838987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6e15adb4-854e-4db9-96a1-ddcdf3ade7a0 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:00.844736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9e1c8af6-c6e1-4ed2-976c-d6a0c45a6b5d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:00.854534 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9e1c8af6-c6e1-4ed2-976c-d6a0c45a6b5d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.155639 Jun 22 17:04:00.856240 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 243/467] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:00 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:00.891610 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6e15adb4-854e-4db9-96a1-ddcdf3ade7a0 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:00.898418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6e15adb4-854e-4db9-96a1-ddcdf3ade7a0 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1219 microversion: 2.1 time: 0.063801 Jun 22 17:04:00.898982 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 225/468] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:00 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:01.181923 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-0d07b58b-7c44-4d34-89d5-d6455946a693 req-75dc99f5-70df-4ea5-9fcb-8e37083a548e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2b04e-ad8d-4468-9f45-91ce07db3fbe", "name": "network-vif-plugged", "status": "completed", "tag": "d4c66ab3-2ffd-425f-9e48-6a35b15335cd"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:01.191760 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-0d07b58b-7c44-4d34-89d5-d6455946a693 req-75dc99f5-70df-4ea5-9fcb-8e37083a548e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:01.192225 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-0d07b58b-7c44-4d34-89d5-d6455946a693 req-75dc99f5-70df-4ea5-9fcb-8e37083a548e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:01.202982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-0d07b58b-7c44-4d34-89d5-d6455946a693 req-75dc99f5-70df-4ea5-9fcb-8e37083a548e service nova] Creating event network-vif-plugged:d4c66ab3-2ffd-425f-9e48-6a35b15335cd for instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe on hv-cinder-81045 Jun 22 17:04:01.208046 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-0d07b58b-7c44-4d34-89d5-d6455946a693 req-75dc99f5-70df-4ea5-9fcb-8e37083a548e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030382 Jun 22 17:04:01.208657 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 244/469] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:04:01.870696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0b2cd14a-0f8e-4274-a799-fc5bec29ef77 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:01.871297 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0b2cd14a-0f8e-4274-a799-fc5bec29ef77 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:01.878535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b2cd14a-0f8e-4274-a799-fc5bec29ef77 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:01.878980 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b2cd14a-0f8e-4274-a799-fc5bec29ef77 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:01.879734 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b2cd14a-0f8e-4274-a799-fc5bec29ef77 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:01.880188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b2cd14a-0f8e-4274-a799-fc5bec29ef77 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:01.915978 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c974cf05-2a90-448f-aadc-c85f83b33667 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:01.916723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c974cf05-2a90-448f-aadc-c85f83b33667 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:01.923200 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c974cf05-2a90-448f-aadc-c85f83b33667 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:01.923645 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c974cf05-2a90-448f-aadc-c85f83b33667 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:01.924467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c974cf05-2a90-448f-aadc-c85f83b33667 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:01.924899 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c974cf05-2a90-448f-aadc-c85f83b33667 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:01.988625 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c974cf05-2a90-448f-aadc-c85f83b33667 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:01.996612 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c974cf05-2a90-448f-aadc-c85f83b33667 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1223 microversion: 2.1 time: 0.085225 Jun 22 17:04:01.997279 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 245/470] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:01 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:02.015316 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0b2cd14a-0f8e-4274-a799-fc5bec29ef77 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:02.022747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0b2cd14a-0f8e-4274-a799-fc5bec29ef77 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.155873 Jun 22 17:04:02.023378 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 226/471] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:01 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:03.013056 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-34b47eb5-87b0-4da0-9293-d6ce30101a88 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:03.013646 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-34b47eb5-87b0-4da0-9293-d6ce30101a88 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:03.020153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34b47eb5-87b0-4da0-9293-d6ce30101a88 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:03.020607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34b47eb5-87b0-4da0-9293-d6ce30101a88 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:03.021371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34b47eb5-87b0-4da0-9293-d6ce30101a88 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:03.021804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34b47eb5-87b0-4da0-9293-d6ce30101a88 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:03.039929 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7136485b-377d-4686-8cc2-687786d5d9cd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:03.040611 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7136485b-377d-4686-8cc2-687786d5d9cd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:03.047164 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7136485b-377d-4686-8cc2-687786d5d9cd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:03.047613 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7136485b-377d-4686-8cc2-687786d5d9cd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:03.048434 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7136485b-377d-4686-8cc2-687786d5d9cd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:03.048874 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7136485b-377d-4686-8cc2-687786d5d9cd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:03.084062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-34b47eb5-87b0-4da0-9293-d6ce30101a88 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:03.092897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-34b47eb5-87b0-4da0-9293-d6ce30101a88 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1223 microversion: 2.1 time: 0.083546 Jun 22 17:04:03.093483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 246/472] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:03 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:03.183310 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7136485b-377d-4686-8cc2-687786d5d9cd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:03.190932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7136485b-377d-4686-8cc2-687786d5d9cd tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1259 microversion: 2.1 time: 0.155469 Jun 22 17:04:03.191491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 227/473] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:03 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:04.110188 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f9a5d2e2-8270-4f0e-8338-e4afe2341595 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:04.110896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f9a5d2e2-8270-4f0e-8338-e4afe2341595 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:04.117667 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f9a5d2e2-8270-4f0e-8338-e4afe2341595 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:04.118112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f9a5d2e2-8270-4f0e-8338-e4afe2341595 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:04.118861 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f9a5d2e2-8270-4f0e-8338-e4afe2341595 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:04.119289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f9a5d2e2-8270-4f0e-8338-e4afe2341595 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:04.182009 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f9a5d2e2-8270-4f0e-8338-e4afe2341595 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:04.189370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f9a5d2e2-8270-4f0e-8338-e4afe2341595 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1271 microversion: 2.1 time: 0.083060 Jun 22 17:04:04.189926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 247/474] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:04 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:04.208009 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1e435c32-fe8d-49da-a8b6-e29d39b7d0db tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:04.208653 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1e435c32-fe8d-49da-a8b6-e29d39b7d0db tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:04.215520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e435c32-fe8d-49da-a8b6-e29d39b7d0db tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:04.215949 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e435c32-fe8d-49da-a8b6-e29d39b7d0db tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:04.216748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e435c32-fe8d-49da-a8b6-e29d39b7d0db tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:04.217181 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e435c32-fe8d-49da-a8b6-e29d39b7d0db tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:04.348002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1e435c32-fe8d-49da-a8b6-e29d39b7d0db tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:04.356069 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1e435c32-fe8d-49da-a8b6-e29d39b7d0db tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1443 microversion: 2.1 time: 0.151854 Jun 22 17:04:04.356658 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 228/475] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:04 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:04.372023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1e4f29b7-773c-499f-b6e1-1c04e2174fcc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:04.372685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1e4f29b7-773c-499f-b6e1-1c04e2174fcc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:04.378558 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e4f29b7-773c-499f-b6e1-1c04e2174fcc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:04.379004 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e4f29b7-773c-499f-b6e1-1c04e2174fcc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:04.379757 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e4f29b7-773c-499f-b6e1-1c04e2174fcc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:04.380211 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1e4f29b7-773c-499f-b6e1-1c04e2174fcc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:04.510309 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1e4f29b7-773c-499f-b6e1-1c04e2174fcc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:04.517847 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1e4f29b7-773c-499f-b6e1-1c04e2174fcc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1443 microversion: 2.1 time: 0.149570 Jun 22 17:04:04.518405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 248/476] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:04 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:05.206504 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-922b288c-6036-4e01-b95a-9e99365100d7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:05.207119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-922b288c-6036-4e01-b95a-9e99365100d7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:05.214642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-922b288c-6036-4e01-b95a-9e99365100d7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:05.215963 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-922b288c-6036-4e01-b95a-9e99365100d7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:05.217000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-922b288c-6036-4e01-b95a-9e99365100d7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:05.218100 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-922b288c-6036-4e01-b95a-9e99365100d7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:05.295004 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-922b288c-6036-4e01-b95a-9e99365100d7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:05.302781 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-922b288c-6036-4e01-b95a-9e99365100d7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1277 microversion: 2.1 time: 0.100297 Jun 22 17:04:05.304966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 229/477] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:05 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:06.326514 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-553166f4-e2e5-4114-ae8d-27cc1a1b4062 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:06.327175 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-553166f4-e2e5-4114-ae8d-27cc1a1b4062 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:06.333975 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-553166f4-e2e5-4114-ae8d-27cc1a1b4062 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:06.337937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-553166f4-e2e5-4114-ae8d-27cc1a1b4062 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:06.337937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-553166f4-e2e5-4114-ae8d-27cc1a1b4062 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:06.337937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-553166f4-e2e5-4114-ae8d-27cc1a1b4062 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:06.342544 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-14849bbf-fa45-4dbc-b610-4502316d7ca2 req-c84efaf1-2922-4028-af11-f44dac959068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598ed68d-acfd-46be-9071-0904eabfcd91", "tag": "be7fdef5-1db7-4cbb-b6d8-04757d6d68ab"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:06.353706 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-14849bbf-fa45-4dbc-b610-4502316d7ca2 req-c84efaf1-2922-4028-af11-f44dac959068 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:06.354577 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-14849bbf-fa45-4dbc-b610-4502316d7ca2 req-c84efaf1-2922-4028-af11-f44dac959068 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:06.369280 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-14849bbf-fa45-4dbc-b610-4502316d7ca2 req-c84efaf1-2922-4028-af11-f44dac959068 service nova] Creating event network-changed:be7fdef5-1db7-4cbb-b6d8-04757d6d68ab for instance 598ed68d-acfd-46be-9071-0904eabfcd91 on hv-cinder-81045 Jun 22 17:04:06.374532 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-14849bbf-fa45-4dbc-b610-4502316d7ca2 req-c84efaf1-2922-4028-af11-f44dac959068 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038386 Jun 22 17:04:06.375242 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 230/478] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:04:06.496656 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-553166f4-e2e5-4114-ae8d-27cc1a1b4062 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:06.498855 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-553166f4-e2e5-4114-ae8d-27cc1a1b4062 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.176399 Jun 22 17:04:06.499385 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 249/479] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:06 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:06.589716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-2b3a966c-d24c-4011-b071-a09b96c67d74 req-1054522d-dfff-4d6c-a852-caff33913ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c2b04e-ad8d-4468-9f45-91ce07db3fbe", "tag": "d4c66ab3-2ffd-425f-9e48-6a35b15335cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:06.598485 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2b3a966c-d24c-4011-b071-a09b96c67d74 req-1054522d-dfff-4d6c-a852-caff33913ca9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:06.598925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2b3a966c-d24c-4011-b071-a09b96c67d74 req-1054522d-dfff-4d6c-a852-caff33913ca9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:06.609457 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-2b3a966c-d24c-4011-b071-a09b96c67d74 req-1054522d-dfff-4d6c-a852-caff33913ca9 service nova] Creating event network-changed:d4c66ab3-2ffd-425f-9e48-6a35b15335cd for instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe on hv-cinder-81045 Jun 22 17:04:06.614113 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-2b3a966c-d24c-4011-b071-a09b96c67d74 req-1054522d-dfff-4d6c-a852-caff33913ca9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028286 Jun 22 17:04:06.614685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 231/480] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:04:07.521309 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-34959d20-9d99-4567-a69b-98fc608fa623 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:07.530586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-34959d20-9d99-4567-a69b-98fc608fa623 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:07.532994 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34959d20-9d99-4567-a69b-98fc608fa623 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:07.533458 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34959d20-9d99-4567-a69b-98fc608fa623 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:07.534234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34959d20-9d99-4567-a69b-98fc608fa623 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:07.534661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-34959d20-9d99-4567-a69b-98fc608fa623 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:07.744483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-34959d20-9d99-4567-a69b-98fc608fa623 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:07.751977 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-34959d20-9d99-4567-a69b-98fc608fa623 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.239483 Jun 22 17:04:07.760814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 250/481] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:07 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:07.881133 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-940e117a-1adf-46fe-8b19-efef2abcadf1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:07.882727 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-940e117a-1adf-46fe-8b19-efef2abcadf1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:07.889418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-940e117a-1adf-46fe-8b19-efef2abcadf1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:07.892992 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-940e117a-1adf-46fe-8b19-efef2abcadf1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:07.892992 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-940e117a-1adf-46fe-8b19-efef2abcadf1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:07.892992 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-940e117a-1adf-46fe-8b19-efef2abcadf1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:07.917228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-940e117a-1adf-46fe-8b19-efef2abcadf1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/ips" status: 200 len: 146 microversion: 2.1 time: 0.040634 Jun 22 17:04:07.917797 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 232/482] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 17:04:07 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:04:08.769075 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9e2fc599-1898-4792-859c-e085c753139f tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:08.769684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9e2fc599-1898-4792-859c-e085c753139f tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:08.776028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e2fc599-1898-4792-859c-e085c753139f tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:08.776504 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e2fc599-1898-4792-859c-e085c753139f tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:08.777256 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e2fc599-1898-4792-859c-e085c753139f tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:08.777680 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e2fc599-1898-4792-859c-e085c753139f tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:08.830575 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-526edc14-aac0-41cf-8d1e-d04cf341b520 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:08.831185 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-526edc14-aac0-41cf-8d1e-d04cf341b520 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:08.837188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-526edc14-aac0-41cf-8d1e-d04cf341b520 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:08.837639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-526edc14-aac0-41cf-8d1e-d04cf341b520 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:08.838409 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-526edc14-aac0-41cf-8d1e-d04cf341b520 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:08.838843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-526edc14-aac0-41cf-8d1e-d04cf341b520 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:08.914054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9e2fc599-1898-4792-859c-e085c753139f tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:08.921448 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9e2fc599-1898-4792-859c-e085c753139f tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.156076 Jun 22 17:04:08.922041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 251/483] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:08 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:08.969282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-526edc14-aac0-41cf-8d1e-d04cf341b520 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:08.977161 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-526edc14-aac0-41cf-8d1e-d04cf341b520 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1592 microversion: 2.1 time: 0.150419 Jun 22 17:04:08.977711 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 233/484] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:08 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1592 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:09.938985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e393e8db-142b-485c-bc4a-1d4be2d677f7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:09.939598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e393e8db-142b-485c-bc4a-1d4be2d677f7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:09.946119 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e393e8db-142b-485c-bc4a-1d4be2d677f7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:09.946599 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e393e8db-142b-485c-bc4a-1d4be2d677f7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:09.947359 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e393e8db-142b-485c-bc4a-1d4be2d677f7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:09.947806 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e393e8db-142b-485c-bc4a-1d4be2d677f7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:10.137814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e393e8db-142b-485c-bc4a-1d4be2d677f7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:10.146103 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e393e8db-142b-485c-bc4a-1d4be2d677f7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.211191 Jun 22 17:04:10.154476 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 252/485] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:09 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:10.896446 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-a04d0049-6260-4cb1-b29f-121e82368bc7 req-51c4a05a-b8d1-4c45-9df5-10142acd54e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d468f375-b7cd-4cec-9a77-513abc2daba8", "tag": "3e7194d2-b6a9-470a-93b2-77d89d7aafdb"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:10.901746 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:10.902649 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=8 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:10.908567 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-a04d0049-6260-4cb1-b29f-121e82368bc7 req-51c4a05a-b8d1-4c45-9df5-10142acd54e4 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:10.909196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-a04d0049-6260-4cb1-b29f-121e82368bc7 req-51c4a05a-b8d1-4c45-9df5-10142acd54e4 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:10.920637 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-a04d0049-6260-4cb1-b29f-121e82368bc7 req-51c4a05a-b8d1-4c45-9df5-10142acd54e4 service nova] Creating event network-changed:3e7194d2-b6a9-470a-93b2-77d89d7aafdb for instance d468f375-b7cd-4cec-9a77-513abc2daba8 on hv-cinder-81045 Jun 22 17:04:10.925930 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-a04d0049-6260-4cb1-b29f-121e82368bc7 req-51c4a05a-b8d1-4c45-9df5-10142acd54e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033532 Jun 22 17:04:10.926593 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 234/486] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:04:11.166337 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a36fb681-0237-47e2-8015-f239924a329d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:11.167951 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a36fb681-0237-47e2-8015-f239924a329d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:11.182701 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a36fb681-0237-47e2-8015-f239924a329d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:11.183183 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a36fb681-0237-47e2-8015-f239924a329d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:11.183989 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a36fb681-0237-47e2-8015-f239924a329d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:11.186304 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a36fb681-0237-47e2-8015-f239924a329d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:11.452222 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a36fb681-0237-47e2-8015-f239924a329d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:11.465000 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a36fb681-0237-47e2-8015-f239924a329d tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.305113 Jun 22 17:04:11.465868 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 253/487] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:11 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:12.482969 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ff99a59a-5b04-4257-9be2-7981d7f88726 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:12.483597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ff99a59a-5b04-4257-9be2-7981d7f88726 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:12.490701 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ff99a59a-5b04-4257-9be2-7981d7f88726 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:12.491153 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ff99a59a-5b04-4257-9be2-7981d7f88726 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:12.495157 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ff99a59a-5b04-4257-9be2-7981d7f88726 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:12.495157 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ff99a59a-5b04-4257-9be2-7981d7f88726 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:12.624070 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ff99a59a-5b04-4257-9be2-7981d7f88726 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:12.631565 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ff99a59a-5b04-4257-9be2-7981d7f88726 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.153344 Jun 22 17:04:12.632134 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 235/488] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:12 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:13.333672 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-75b9e058-69d6-4472-abde-1055f7106ba3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1843999012"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:13.334208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-75b9e058-69d6-4472-abde-1055f7106ba3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:13.336647 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=54 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:13.341448 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-75b9e058-69d6-4472-abde-1055f7106ba3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:13.341900 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-75b9e058-69d6-4472-abde-1055f7106ba3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:13.342659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-75b9e058-69d6-4472-abde-1055f7106ba3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:13.343090 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-75b9e058-69d6-4472-abde-1055f7106ba3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:13.469331 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.network.security_group_api [None req-75b9e058-69d6-4472-abde-1055f7106ba3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Adding security group d380a16d-f222-4741-8695-31bce161d6cc to port 3e7194d2-b6a9-470a-93b2-77d89d7aafdb Jun 22 17:04:13.649443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2ad8383a-bf54-4361-a0df-c7e637d39361 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:13.650067 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2ad8383a-bf54-4361-a0df-c7e637d39361 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:13.652470 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:13.657202 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ad8383a-bf54-4361-a0df-c7e637d39361 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:13.657900 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ad8383a-bf54-4361-a0df-c7e637d39361 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:13.658661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ad8383a-bf54-4361-a0df-c7e637d39361 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:13.659093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ad8383a-bf54-4361-a0df-c7e637d39361 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:13.787181 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2ad8383a-bf54-4361-a0df-c7e637d39361 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:13.794992 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2ad8383a-bf54-4361-a0df-c7e637d39361 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.150048 Jun 22 17:04:13.795546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 236/489] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:13 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:13.883005 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-75b9e058-69d6-4472-abde-1055f7106ba3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "POST /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/action" status: 202 len: 0 microversion: 2.1 time: 0.552689 Jun 22 17:04:13.888725 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 254/490] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:04:13 2022] POST /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:04:13.889949 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-9282d09a-c60d-4cf3-9879-d5684013396a req-62b00d6d-78da-484c-aea7-b7f837e20b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d468f375-b7cd-4cec-9a77-513abc2daba8", "tag": "3e7194d2-b6a9-470a-93b2-77d89d7aafdb"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:13.894894 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3a9fda81-95c3-4461-9ee7-f97b11ff67f3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:13.895582 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3a9fda81-95c3-4461-9ee7-f97b11ff67f3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:13.898806 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-9282d09a-c60d-4cf3-9879-d5684013396a req-62b00d6d-78da-484c-aea7-b7f837e20b77 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:13.900183 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-9282d09a-c60d-4cf3-9879-d5684013396a req-62b00d6d-78da-484c-aea7-b7f837e20b77 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:13.912091 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a9fda81-95c3-4461-9ee7-f97b11ff67f3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:13.912840 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a9fda81-95c3-4461-9ee7-f97b11ff67f3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:13.913835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a9fda81-95c3-4461-9ee7-f97b11ff67f3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:13.914334 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a9fda81-95c3-4461-9ee7-f97b11ff67f3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:13.922327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-9282d09a-c60d-4cf3-9879-d5684013396a req-62b00d6d-78da-484c-aea7-b7f837e20b77 service nova] Creating event network-changed:3e7194d2-b6a9-470a-93b2-77d89d7aafdb for instance d468f375-b7cd-4cec-9a77-513abc2daba8 on hv-cinder-81045 Jun 22 17:04:13.935986 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-9282d09a-c60d-4cf3-9879-d5684013396a req-62b00d6d-78da-484c-aea7-b7f837e20b77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049254 Jun 22 17:04:13.937014 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 237/491] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:04:13.991046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e4a14540-3451-49d5-a5cd-19c2838d655d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "612a6794-a3db-4828-99aa-4a768eec32ff"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:13.992716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e4a14540-3451-49d5-a5cd-19c2838d655d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:13.999801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4a14540-3451-49d5-a5cd-19c2838d655d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:14.000287 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4a14540-3451-49d5-a5cd-19c2838d655d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:14.001069 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4a14540-3451-49d5-a5cd-19c2838d655d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:14.001626 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4a14540-3451-49d5-a5cd-19c2838d655d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:14.196016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a9fda81-95c3-4461-9ee7-f97b11ff67f3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:14.204732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3a9fda81-95c3-4461-9ee7-f97b11ff67f3 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1757 microversion: 2.1 time: 0.314500 Jun 22 17:04:14.205311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 255/492] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:13 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1757 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:14.811158 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-63e042c2-aa21-4a4d-a746-8c2c8c339d64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:14.811848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-63e042c2-aa21-4a4d-a746-8c2c8c339d64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:14.818359 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-63e042c2-aa21-4a4d-a746-8c2c8c339d64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:14.818801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-63e042c2-aa21-4a4d-a746-8c2c8c339d64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:14.819567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-63e042c2-aa21-4a4d-a746-8c2c8c339d64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:14.820005 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-63e042c2-aa21-4a4d-a746-8c2c8c339d64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:14.848419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e4a14540-3451-49d5-a5cd-19c2838d655d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.861261 Jun 22 17:04:14.850888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 238/493] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:04:13 2022] POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:04:14.957149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-63e042c2-aa21-4a4d-a746-8c2c8c339d64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:14.965444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-63e042c2-aa21-4a4d-a746-8c2c8c339d64 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.158269 Jun 22 17:04:14.965992 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 256/494] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:14 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:15.982082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-869c951e-cf47-4667-a9d9-3789210e685c tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:15.982884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-869c951e-cf47-4667-a9d9-3789210e685c tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:15.989497 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-869c951e-cf47-4667-a9d9-3789210e685c tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:15.989954 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-869c951e-cf47-4667-a9d9-3789210e685c tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:15.990730 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-869c951e-cf47-4667-a9d9-3789210e685c tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:15.991168 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-869c951e-cf47-4667-a9d9-3789210e685c tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:16.134503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-869c951e-cf47-4667-a9d9-3789210e685c tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:16.143026 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-869c951e-cf47-4667-a9d9-3789210e685c tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.164887 Jun 22 17:04:16.150937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6dd0ca69-6736-46d4-ad21-3c337f1327ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b47e8965-a575-47c3-9dac-ad7368a14ef2"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:16.153230 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 239/495] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:15 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:16.153786 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6dd0ca69-6736-46d4-ad21-3c337f1327ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:16.159197 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-ebc52ebe-cb1b-4dfc-8b33-f244503d3653 req-e3b5830a-d55b-4f4d-b002-2296f228ea1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598ed68d-acfd-46be-9071-0904eabfcd91", "name": "network-vif-plugged", "status": "completed", "tag": "be7fdef5-1db7-4cbb-b6d8-04757d6d68ab"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:16.167305 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ebc52ebe-cb1b-4dfc-8b33-f244503d3653 req-e3b5830a-d55b-4f4d-b002-2296f228ea1c service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:16.167739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ebc52ebe-cb1b-4dfc-8b33-f244503d3653 req-e3b5830a-d55b-4f4d-b002-2296f228ea1c service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:16.168065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6dd0ca69-6736-46d4-ad21-3c337f1327ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:16.168631 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6dd0ca69-6736-46d4-ad21-3c337f1327ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:16.169475 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6dd0ca69-6736-46d4-ad21-3c337f1327ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:16.169988 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6dd0ca69-6736-46d4-ad21-3c337f1327ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:16.171452 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:16.178490 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-ebc52ebe-cb1b-4dfc-8b33-f244503d3653 req-e3b5830a-d55b-4f4d-b002-2296f228ea1c service nova] Creating event network-vif-plugged:be7fdef5-1db7-4cbb-b6d8-04757d6d68ab for instance 598ed68d-acfd-46be-9071-0904eabfcd91 on hv-cinder-81045 Jun 22 17:04:16.184285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-ebc52ebe-cb1b-4dfc-8b33-f244503d3653 req-e3b5830a-d55b-4f4d-b002-2296f228ea1c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029691 Jun 22 17:04:16.186886 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 240/496] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:04:16.678382 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:16.801146 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6dd0ca69-6736-46d4-ad21-3c337f1327ee tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770591 Jun 22 17:04:16.801744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 257/497] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:04:16 2022] POST /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:04:17.161638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d0826a21-f1f0-4a9f-9975-cdbf87137cc8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:17.162956 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d0826a21-f1f0-4a9f-9975-cdbf87137cc8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:17.169463 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0826a21-f1f0-4a9f-9975-cdbf87137cc8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:17.169906 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0826a21-f1f0-4a9f-9975-cdbf87137cc8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:17.170651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0826a21-f1f0-4a9f-9975-cdbf87137cc8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:17.171079 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0826a21-f1f0-4a9f-9975-cdbf87137cc8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:17.304085 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d0826a21-f1f0-4a9f-9975-cdbf87137cc8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:17.311940 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d0826a21-f1f0-4a9f-9975-cdbf87137cc8 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.155060 Jun 22 17:04:17.312526 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 241/498] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:17 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:18.329794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-18906761-845d-4c87-9ba9-c6496b86cf90 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:18.330406 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-18906761-845d-4c87-9ba9-c6496b86cf90 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:18.336568 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-18906761-845d-4c87-9ba9-c6496b86cf90 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:18.337009 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-18906761-845d-4c87-9ba9-c6496b86cf90 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:18.337752 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-18906761-845d-4c87-9ba9-c6496b86cf90 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:18.338206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-18906761-845d-4c87-9ba9-c6496b86cf90 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:18.708896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-18906761-845d-4c87-9ba9-c6496b86cf90 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:18.716992 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-18906761-845d-4c87-9ba9-c6496b86cf90 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1319 microversion: 2.1 time: 0.391970 Jun 22 17:04:18.717547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 258/499] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:18 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:19.734186 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8aa62294-2c1b-4923-a482-3160a5c57dd2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:19.734786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8aa62294-2c1b-4923-a482-3160a5c57dd2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:19.741145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8aa62294-2c1b-4923-a482-3160a5c57dd2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:19.741591 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8aa62294-2c1b-4923-a482-3160a5c57dd2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:19.742340 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8aa62294-2c1b-4923-a482-3160a5c57dd2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:19.742769 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8aa62294-2c1b-4923-a482-3160a5c57dd2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:19.870291 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8aa62294-2c1b-4923-a482-3160a5c57dd2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:19.877918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8aa62294-2c1b-4923-a482-3160a5c57dd2 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1507 microversion: 2.1 time: 0.148138 Jun 22 17:04:19.878464 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 242/500] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:19 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:19.894323 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-44bae9fe-a194-4b99-9df3-4bc132660122 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74fbffdb-fc29-4b08-8974-3b22da8e2a8f", "device": "/dev/sdb"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:19.895482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-44bae9fe-a194-4b99-9df3-4bc132660122 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:19.901935 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-44bae9fe-a194-4b99-9df3-4bc132660122 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:19.902384 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-44bae9fe-a194-4b99-9df3-4bc132660122 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:19.903737 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-44bae9fe-a194-4b99-9df3-4bc132660122 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:19.904218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-44bae9fe-a194-4b99-9df3-4bc132660122 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:20.563616 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-44bae9fe-a194-4b99-9df3-4bc132660122 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "POST /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672592 Jun 22 17:04:20.564385 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 259/501] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:04:19 2022] POST /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:04:23.383511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0a381506-bd9b-45af-8cfa-80b163573724 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:23.390363 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0a381506-bd9b-45af-8cfa-80b163573724 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:23.390810 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0a381506-bd9b-45af-8cfa-80b163573724 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:23.451294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0a381506-bd9b-45af-8cfa-80b163573724 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Going to try to stop instance {{(pid=118472) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 17:04:23.588451 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0a381506-bd9b-45af-8cfa-80b163573724 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/action" status: 202 len: 0 microversion: 2.1 time: 0.208662 Jun 22 17:04:23.588953 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 243/502] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:04:23 2022] POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:04:23.601491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0a2e6243-7dd6-4103-8384-754642465977 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:23.602189 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0a2e6243-7dd6-4103-8384-754642465977 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:23.609087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0a2e6243-7dd6-4103-8384-754642465977 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:23.609539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0a2e6243-7dd6-4103-8384-754642465977 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:23.610301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0a2e6243-7dd6-4103-8384-754642465977 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:23.610733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0a2e6243-7dd6-4103-8384-754642465977 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:23.741729 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0a2e6243-7dd6-4103-8384-754642465977 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:23.749748 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0a2e6243-7dd6-4103-8384-754642465977 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.152998 Jun 22 17:04:23.750304 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 260/503] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:23 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:24.768306 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-25e65460-5742-4bc6-9765-ee6eaacfd693 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:24.768997 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-25e65460-5742-4bc6-9765-ee6eaacfd693 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:24.775069 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25e65460-5742-4bc6-9765-ee6eaacfd693 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:24.775522 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25e65460-5742-4bc6-9765-ee6eaacfd693 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:24.776314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25e65460-5742-4bc6-9765-ee6eaacfd693 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:24.776753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25e65460-5742-4bc6-9765-ee6eaacfd693 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:24.908814 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-25e65460-5742-4bc6-9765-ee6eaacfd693 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:24.916573 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-25e65460-5742-4bc6-9765-ee6eaacfd693 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.153134 Jun 22 17:04:24.917121 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 244/504] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:24 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:25.935228 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5ba04e58-8a77-419e-a28b-01b081737450 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:25.936180 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5ba04e58-8a77-419e-a28b-01b081737450 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:25.942798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5ba04e58-8a77-419e-a28b-01b081737450 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:25.943248 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5ba04e58-8a77-419e-a28b-01b081737450 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:25.944004 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5ba04e58-8a77-419e-a28b-01b081737450 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:25.944462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5ba04e58-8a77-419e-a28b-01b081737450 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:26.079240 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5ba04e58-8a77-419e-a28b-01b081737450 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:26.087302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5ba04e58-8a77-419e-a28b-01b081737450 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.156345 Jun 22 17:04:26.087800 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 261/505] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:25 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:27.104878 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-71a3495a-82b1-4a4c-a3f0-78a3ff49e491 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:27.105473 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-71a3495a-82b1-4a4c-a3f0-78a3ff49e491 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:27.111929 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-71a3495a-82b1-4a4c-a3f0-78a3ff49e491 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:27.112416 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-71a3495a-82b1-4a4c-a3f0-78a3ff49e491 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:27.113179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-71a3495a-82b1-4a4c-a3f0-78a3ff49e491 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:27.113617 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-71a3495a-82b1-4a4c-a3f0-78a3ff49e491 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:27.242604 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-71a3495a-82b1-4a4c-a3f0-78a3ff49e491 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:27.250887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-71a3495a-82b1-4a4c-a3f0-78a3ff49e491 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.149837 Jun 22 17:04:27.251438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 245/506] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:27 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:28.267877 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1106888d-03df-4fda-935d-d519c9b51a87 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:28.268474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1106888d-03df-4fda-935d-d519c9b51a87 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:28.274978 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1106888d-03df-4fda-935d-d519c9b51a87 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:28.275419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1106888d-03df-4fda-935d-d519c9b51a87 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:28.276375 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1106888d-03df-4fda-935d-d519c9b51a87 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:28.276808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1106888d-03df-4fda-935d-d519c9b51a87 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:28.402347 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1106888d-03df-4fda-935d-d519c9b51a87 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:28.410579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1106888d-03df-4fda-935d-d519c9b51a87 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.146604 Jun 22 17:04:28.411141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 262/507] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:28 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:29.428261 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a1b15e7a-009e-4dbd-badb-7b66287c5764 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:29.428891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a1b15e7a-009e-4dbd-badb-7b66287c5764 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:29.435763 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1b15e7a-009e-4dbd-badb-7b66287c5764 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:29.436502 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1b15e7a-009e-4dbd-badb-7b66287c5764 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:29.436987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1b15e7a-009e-4dbd-badb-7b66287c5764 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:29.437415 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1b15e7a-009e-4dbd-badb-7b66287c5764 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:29.577270 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a1b15e7a-009e-4dbd-badb-7b66287c5764 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:29.585248 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a1b15e7a-009e-4dbd-badb-7b66287c5764 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.161035 Jun 22 17:04:29.585794 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 246/508] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:29 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:30.599235 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-28e94cac-7818-49fd-b68b-85ec0764ff2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:30.600385 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-28e94cac-7818-49fd-b68b-85ec0764ff2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:30.602191 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-972f248e-5c0c-410b-94b0-0314d12a3378 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:30.602801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-972f248e-5c0c-410b-94b0-0314d12a3378 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:30.607963 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-28e94cac-7818-49fd-b68b-85ec0764ff2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:30.614149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-28e94cac-7818-49fd-b68b-85ec0764ff2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:30.614149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-28e94cac-7818-49fd-b68b-85ec0764ff2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:30.614149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-28e94cac-7818-49fd-b68b-85ec0764ff2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:30.614421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-972f248e-5c0c-410b-94b0-0314d12a3378 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:30.614421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-972f248e-5c0c-410b-94b0-0314d12a3378 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:30.615374 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-972f248e-5c0c-410b-94b0-0314d12a3378 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:30.616255 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-972f248e-5c0c-410b-94b0-0314d12a3378 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:30.634157 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-28e94cac-7818-49fd-b68b-85ec0764ff2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lazy-loading 'flavor' on Instance uuid b64220c7-ae61-46ea-ad86-122aee7e0a1a {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:04:30.750422 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-972f248e-5c0c-410b-94b0-0314d12a3378 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:30.758198 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-972f248e-5c0c-410b-94b0-0314d12a3378 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.160269 Jun 22 17:04:30.758754 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 247/509] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:30 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:30.990688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-28e94cac-7818-49fd-b68b-85ec0764ff2c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/action" status: 200 len: 32 microversion: 2.1 time: 0.395700 Jun 22 17:04:30.991221 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 263/510] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:04:30 2022] POST /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/action => generated 32 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 17:04:31.002124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2b418943-be87-4ba8-a58d-16e711588d8f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:31.002728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2b418943-be87-4ba8-a58d-16e711588d8f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:31.008797 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b418943-be87-4ba8-a58d-16e711588d8f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:31.009243 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b418943-be87-4ba8-a58d-16e711588d8f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:31.010009 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b418943-be87-4ba8-a58d-16e711588d8f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:31.010474 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b418943-be87-4ba8-a58d-16e711588d8f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:31.144096 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2b418943-be87-4ba8-a58d-16e711588d8f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:31.152651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2b418943-be87-4ba8-a58d-16e711588d8f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.154474 Jun 22 17:04:31.153231 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 248/511] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:30 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:31.780291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c3a06d24-15ee-4b77-a357-8350007bddce tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:31.780291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c3a06d24-15ee-4b77-a357-8350007bddce tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:31.784345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c3a06d24-15ee-4b77-a357-8350007bddce tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:31.784792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c3a06d24-15ee-4b77-a357-8350007bddce tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:31.785547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c3a06d24-15ee-4b77-a357-8350007bddce tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:31.785977 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c3a06d24-15ee-4b77-a357-8350007bddce tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:31.915216 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c3a06d24-15ee-4b77-a357-8350007bddce tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:31.922985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c3a06d24-15ee-4b77-a357-8350007bddce tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.150938 Jun 22 17:04:31.923539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 264/512] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:31 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:32.169999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ee6e307c-2209-4166-bb2f-c3a6b93b261a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:32.170609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ee6e307c-2209-4166-bb2f-c3a6b93b261a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:32.177117 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee6e307c-2209-4166-bb2f-c3a6b93b261a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:32.177571 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee6e307c-2209-4166-bb2f-c3a6b93b261a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:32.178331 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee6e307c-2209-4166-bb2f-c3a6b93b261a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:32.178764 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee6e307c-2209-4166-bb2f-c3a6b93b261a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:32.305805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ee6e307c-2209-4166-bb2f-c3a6b93b261a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:32.314280 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ee6e307c-2209-4166-bb2f-c3a6b93b261a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.148008 Jun 22 17:04:32.317175 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 249/513] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:32 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:32.940698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c44f4afb-2cde-40a5-b549-358ff15f4089 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:32.941243 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c44f4afb-2cde-40a5-b549-358ff15f4089 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:32.947490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c44f4afb-2cde-40a5-b549-358ff15f4089 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:32.947931 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c44f4afb-2cde-40a5-b549-358ff15f4089 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:32.948724 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c44f4afb-2cde-40a5-b549-358ff15f4089 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:32.949177 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c44f4afb-2cde-40a5-b549-358ff15f4089 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:33.080443 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c44f4afb-2cde-40a5-b549-358ff15f4089 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:33.088486 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c44f4afb-2cde-40a5-b549-358ff15f4089 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.151666 Jun 22 17:04:33.089043 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 265/514] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:32 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:33.330712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b5c011f7-2eab-40c3-a24a-cb84bbc84c9a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:33.331322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b5c011f7-2eab-40c3-a24a-cb84bbc84c9a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:33.337673 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b5c011f7-2eab-40c3-a24a-cb84bbc84c9a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:33.338131 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b5c011f7-2eab-40c3-a24a-cb84bbc84c9a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:33.338901 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b5c011f7-2eab-40c3-a24a-cb84bbc84c9a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:33.339336 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b5c011f7-2eab-40c3-a24a-cb84bbc84c9a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:33.473149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b5c011f7-2eab-40c3-a24a-cb84bbc84c9a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:33.481796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b5c011f7-2eab-40c3-a24a-cb84bbc84c9a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.154415 Jun 22 17:04:33.482347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 250/515] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:33 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:34.105246 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-24e18470-ec8d-43e9-9d77-1ada021de088 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:34.105849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-24e18470-ec8d-43e9-9d77-1ada021de088 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:34.112836 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-24e18470-ec8d-43e9-9d77-1ada021de088 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:34.113281 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-24e18470-ec8d-43e9-9d77-1ada021de088 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:34.114095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-24e18470-ec8d-43e9-9d77-1ada021de088 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:34.114520 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-24e18470-ec8d-43e9-9d77-1ada021de088 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:34.244816 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-24e18470-ec8d-43e9-9d77-1ada021de088 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:34.253996 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-24e18470-ec8d-43e9-9d77-1ada021de088 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.152543 Jun 22 17:04:34.254550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 266/516] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:34 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:34.498769 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-734939da-05ef-4a27-9501-30be3a8e1ae7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:34.499402 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-734939da-05ef-4a27-9501-30be3a8e1ae7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:34.505882 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-734939da-05ef-4a27-9501-30be3a8e1ae7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:34.506238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-734939da-05ef-4a27-9501-30be3a8e1ae7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:34.507028 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-734939da-05ef-4a27-9501-30be3a8e1ae7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:34.507458 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-734939da-05ef-4a27-9501-30be3a8e1ae7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:34.632257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-734939da-05ef-4a27-9501-30be3a8e1ae7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:34.640075 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-734939da-05ef-4a27-9501-30be3a8e1ae7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.145063 Jun 22 17:04:34.640643 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 251/517] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:34 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:35.270820 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fc4a5263-7bbb-4173-b5a1-8872172778a2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:35.271344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fc4a5263-7bbb-4173-b5a1-8872172778a2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:35.277750 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fc4a5263-7bbb-4173-b5a1-8872172778a2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:35.278672 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fc4a5263-7bbb-4173-b5a1-8872172778a2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:35.279420 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fc4a5263-7bbb-4173-b5a1-8872172778a2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:35.279853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fc4a5263-7bbb-4173-b5a1-8872172778a2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:35.412582 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fc4a5263-7bbb-4173-b5a1-8872172778a2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:35.420472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fc4a5263-7bbb-4173-b5a1-8872172778a2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.153588 Jun 22 17:04:35.421028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 267/518] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:35 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:35.656976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1675d328-cd71-4312-9a78-45439ce1f00b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:35.657586 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1675d328-cd71-4312-9a78-45439ce1f00b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:35.664443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1675d328-cd71-4312-9a78-45439ce1f00b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:35.664895 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1675d328-cd71-4312-9a78-45439ce1f00b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:35.665660 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1675d328-cd71-4312-9a78-45439ce1f00b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:35.666093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1675d328-cd71-4312-9a78-45439ce1f00b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:35.789955 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1675d328-cd71-4312-9a78-45439ce1f00b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:35.798304 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1675d328-cd71-4312-9a78-45439ce1f00b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.145117 Jun 22 17:04:35.798853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 252/519] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:35 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:36.437718 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5f4ceea9-e226-495b-82c5-91247f920719 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:36.438318 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5f4ceea9-e226-495b-82c5-91247f920719 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:36.444639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5f4ceea9-e226-495b-82c5-91247f920719 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:36.445082 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5f4ceea9-e226-495b-82c5-91247f920719 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:36.445825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5f4ceea9-e226-495b-82c5-91247f920719 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:36.446255 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5f4ceea9-e226-495b-82c5-91247f920719 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:36.571072 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5f4ceea9-e226-495b-82c5-91247f920719 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:36.579371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5f4ceea9-e226-495b-82c5-91247f920719 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.145387 Jun 22 17:04:36.579908 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 268/520] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:36 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:36.815818 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c465cafe-a3fc-45e9-99c3-d459f9739193 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:36.816533 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c465cafe-a3fc-45e9-99c3-d459f9739193 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:36.822852 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c465cafe-a3fc-45e9-99c3-d459f9739193 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:36.823301 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c465cafe-a3fc-45e9-99c3-d459f9739193 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:36.824058 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c465cafe-a3fc-45e9-99c3-d459f9739193 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:36.824521 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c465cafe-a3fc-45e9-99c3-d459f9739193 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:36.954289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c465cafe-a3fc-45e9-99c3-d459f9739193 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:36.962110 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c465cafe-a3fc-45e9-99c3-d459f9739193 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.150183 Jun 22 17:04:36.962965 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 253/521] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:36 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:37.596295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0fb55e15-e7f9-4fe9-81cb-f9023dc4239f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:37.596906 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0fb55e15-e7f9-4fe9-81cb-f9023dc4239f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:37.603370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0fb55e15-e7f9-4fe9-81cb-f9023dc4239f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:37.603818 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0fb55e15-e7f9-4fe9-81cb-f9023dc4239f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:37.604607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0fb55e15-e7f9-4fe9-81cb-f9023dc4239f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:37.605039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0fb55e15-e7f9-4fe9-81cb-f9023dc4239f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:37.733884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0fb55e15-e7f9-4fe9-81cb-f9023dc4239f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:37.741826 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0fb55e15-e7f9-4fe9-81cb-f9023dc4239f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.149408 Jun 22 17:04:37.742402 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 269/522] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:37 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:37.978789 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-27e309e4-d88c-4a08-aaf1-3dd235cf8057 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:37.979355 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-27e309e4-d88c-4a08-aaf1-3dd235cf8057 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:37.986514 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27e309e4-d88c-4a08-aaf1-3dd235cf8057 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:37.989050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27e309e4-d88c-4a08-aaf1-3dd235cf8057 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:37.989050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27e309e4-d88c-4a08-aaf1-3dd235cf8057 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:37.989050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27e309e4-d88c-4a08-aaf1-3dd235cf8057 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:38.114651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-27e309e4-d88c-4a08-aaf1-3dd235cf8057 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:38.123587 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-27e309e4-d88c-4a08-aaf1-3dd235cf8057 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.148476 Jun 22 17:04:38.124466 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 254/523] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:37 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:38.759510 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-90e4da61-0f0b-4356-b669-f3d10a0e3701 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:38.760175 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-90e4da61-0f0b-4356-b669-f3d10a0e3701 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:38.767103 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-90e4da61-0f0b-4356-b669-f3d10a0e3701 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:38.767551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-90e4da61-0f0b-4356-b669-f3d10a0e3701 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:38.768347 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-90e4da61-0f0b-4356-b669-f3d10a0e3701 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:38.768779 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-90e4da61-0f0b-4356-b669-f3d10a0e3701 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:38.903503 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-90e4da61-0f0b-4356-b669-f3d10a0e3701 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:38.907697 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:38.913112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-90e4da61-0f0b-4356-b669-f3d10a0e3701 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1723 microversion: 2.1 time: 0.157567 Jun 22 17:04:38.913672 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 270/524] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:38 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:39.141253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-48597ed2-36ad-4e09-92d7-fea17fe75230 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:39.141817 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-48597ed2-36ad-4e09-92d7-fea17fe75230 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:39.148227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48597ed2-36ad-4e09-92d7-fea17fe75230 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:39.148736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48597ed2-36ad-4e09-92d7-fea17fe75230 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:39.149505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48597ed2-36ad-4e09-92d7-fea17fe75230 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:39.149932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48597ed2-36ad-4e09-92d7-fea17fe75230 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:39.280461 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-48597ed2-36ad-4e09-92d7-fea17fe75230 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:39.288529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-48597ed2-36ad-4e09-92d7-fea17fe75230 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.151892 Jun 22 17:04:39.289089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 255/525] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:39 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:39.929754 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-958e5c8d-f3d8-4562-ad41-18d53334d824 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:39.930370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-958e5c8d-f3d8-4562-ad41-18d53334d824 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:39.937444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-958e5c8d-f3d8-4562-ad41-18d53334d824 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:39.937898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-958e5c8d-f3d8-4562-ad41-18d53334d824 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:39.938658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-958e5c8d-f3d8-4562-ad41-18d53334d824 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:39.939096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-958e5c8d-f3d8-4562-ad41-18d53334d824 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:40.066770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-958e5c8d-f3d8-4562-ad41-18d53334d824 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:40.074826 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-958e5c8d-f3d8-4562-ad41-18d53334d824 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1700 microversion: 2.1 time: 0.148809 Jun 22 17:04:40.075397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 271/526] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:39 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1700 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:40.092308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-eadcea46-e337-440b-973e-e64c201211e2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:04:40.098392 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eadcea46-e337-440b-973e-e64c201211e2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:40.098840 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eadcea46-e337-440b-973e-e64c201211e2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:40.114503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:40.119928 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-eadcea46-e337-440b-973e-e64c201211e2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Going to try to start instance {{(pid=118472) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 17:04:40.303668 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-eadcea46-e337-440b-973e-e64c201211e2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/action" status: 202 len: 0 microversion: 2.1 time: 0.215483 Jun 22 17:04:40.304443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 256/527] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:04:40 2022] POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:04:40.306914 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d1a66425-1b3e-43b8-a6a8-2047c0889ac0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:40.308315 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d1a66425-1b3e-43b8-a6a8-2047c0889ac0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:40.312813 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-16f0ab73-5512-4e6c-a7ee-6c90000ad608 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:40.313510 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-16f0ab73-5512-4e6c-a7ee-6c90000ad608 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:40.315237 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1a66425-1b3e-43b8-a6a8-2047c0889ac0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:40.315734 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1a66425-1b3e-43b8-a6a8-2047c0889ac0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:40.316804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1a66425-1b3e-43b8-a6a8-2047c0889ac0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:40.317226 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1a66425-1b3e-43b8-a6a8-2047c0889ac0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:40.320652 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-16f0ab73-5512-4e6c-a7ee-6c90000ad608 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:40.321105 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-16f0ab73-5512-4e6c-a7ee-6c90000ad608 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:40.321879 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-16f0ab73-5512-4e6c-a7ee-6c90000ad608 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:40.322312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-16f0ab73-5512-4e6c-a7ee-6c90000ad608 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:40.452581 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-16f0ab73-5512-4e6c-a7ee-6c90000ad608 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:40.452778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d1a66425-1b3e-43b8-a6a8-2047c0889ac0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:40.460490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d1a66425-1b3e-43b8-a6a8-2047c0889ac0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.157633 Jun 22 17:04:40.460659 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-16f0ab73-5512-4e6c-a7ee-6c90000ad608 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1709 microversion: 2.1 time: 0.151791 Jun 22 17:04:40.464505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 272/528] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:40 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:40.464665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 257/528] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:40 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:41.478006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9521ae25-21bb-4e28-b41f-da72f26edae0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:41.478673 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-80540a8e-2cb0-40b0-b313-3c47b2a5298a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:41.479075 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9521ae25-21bb-4e28-b41f-da72f26edae0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:41.479187 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-80540a8e-2cb0-40b0-b313-3c47b2a5298a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:41.485677 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9521ae25-21bb-4e28-b41f-da72f26edae0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:41.485880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80540a8e-2cb0-40b0-b313-3c47b2a5298a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:41.486118 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9521ae25-21bb-4e28-b41f-da72f26edae0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:41.486326 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80540a8e-2cb0-40b0-b313-3c47b2a5298a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:41.486904 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9521ae25-21bb-4e28-b41f-da72f26edae0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:41.487083 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80540a8e-2cb0-40b0-b313-3c47b2a5298a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:41.487336 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9521ae25-21bb-4e28-b41f-da72f26edae0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:41.487594 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80540a8e-2cb0-40b0-b313-3c47b2a5298a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:41.614302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-80540a8e-2cb0-40b0-b313-3c47b2a5298a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:41.617066 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9521ae25-21bb-4e28-b41f-da72f26edae0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:41.622296 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-80540a8e-2cb0-40b0-b313-3c47b2a5298a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.148120 Jun 22 17:04:41.622901 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 273/530] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:41 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:41.625622 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9521ae25-21bb-4e28-b41f-da72f26edae0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1709 microversion: 2.1 time: 0.151401 Jun 22 17:04:41.630184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 258/531] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:41 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:42.639691 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-56db7a43-bc2e-436a-8d70-c01993727028 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:42.640364 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-56db7a43-bc2e-436a-8d70-c01993727028 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:42.642365 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3172ceea-4167-4a9a-b287-8af6779f8452 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:42.642975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3172ceea-4167-4a9a-b287-8af6779f8452 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:42.647050 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-56db7a43-bc2e-436a-8d70-c01993727028 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:42.647523 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-56db7a43-bc2e-436a-8d70-c01993727028 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:42.648298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-56db7a43-bc2e-436a-8d70-c01993727028 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:42.648733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-56db7a43-bc2e-436a-8d70-c01993727028 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:42.649416 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3172ceea-4167-4a9a-b287-8af6779f8452 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:42.649867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3172ceea-4167-4a9a-b287-8af6779f8452 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:42.650774 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3172ceea-4167-4a9a-b287-8af6779f8452 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:42.651065 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3172ceea-4167-4a9a-b287-8af6779f8452 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:42.780056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3172ceea-4167-4a9a-b287-8af6779f8452 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:42.785588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-56db7a43-bc2e-436a-8d70-c01993727028 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:42.788529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3172ceea-4167-4a9a-b287-8af6779f8452 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1709 microversion: 2.1 time: 0.149852 Jun 22 17:04:42.789099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 259/532] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:42 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:42.793901 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-56db7a43-bc2e-436a-8d70-c01993727028 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.158038 Jun 22 17:04:42.795060 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 274/533] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:42 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:43.806852 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-48bac371-9904-4bde-bd3c-df4131180e88 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:43.807491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-48bac371-9904-4bde-bd3c-df4131180e88 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:43.810564 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=48 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:43.810957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b29ad7ad-624e-4241-9742-de03e3f0ec0d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:43.812023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b29ad7ad-624e-4241-9742-de03e3f0ec0d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:43.814515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=42 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:43.815493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48bac371-9904-4bde-bd3c-df4131180e88 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:43.815954 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48bac371-9904-4bde-bd3c-df4131180e88 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:43.816764 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48bac371-9904-4bde-bd3c-df4131180e88 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:43.817198 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48bac371-9904-4bde-bd3c-df4131180e88 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:43.819131 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b29ad7ad-624e-4241-9742-de03e3f0ec0d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:43.819613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b29ad7ad-624e-4241-9742-de03e3f0ec0d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:43.820362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b29ad7ad-624e-4241-9742-de03e3f0ec0d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:43.820798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b29ad7ad-624e-4241-9742-de03e3f0ec0d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:43.947441 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-48bac371-9904-4bde-bd3c-df4131180e88 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:43.955399 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-48bac371-9904-4bde-bd3c-df4131180e88 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1709 microversion: 2.1 time: 0.153190 Jun 22 17:04:43.955961 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 260/534] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:43 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:44.034706 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b29ad7ad-624e-4241-9742-de03e3f0ec0d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:44.042493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b29ad7ad-624e-4241-9742-de03e3f0ec0d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.235868 Jun 22 17:04:44.043058 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 275/535] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:43 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:44.973372 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-00d30c24-94ab-44e4-8212-4e239c60c5bf tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:44.973928 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-00d30c24-94ab-44e4-8212-4e239c60c5bf tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:44.980322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00d30c24-94ab-44e4-8212-4e239c60c5bf tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:44.980768 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00d30c24-94ab-44e4-8212-4e239c60c5bf tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:44.981516 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00d30c24-94ab-44e4-8212-4e239c60c5bf tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:44.981980 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00d30c24-94ab-44e4-8212-4e239c60c5bf tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:45.060946 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bc787f3f-23fd-4a1d-80c8-a05085868234 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:45.061761 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bc787f3f-23fd-4a1d-80c8-a05085868234 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:45.067939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bc787f3f-23fd-4a1d-80c8-a05085868234 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:45.071945 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bc787f3f-23fd-4a1d-80c8-a05085868234 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:45.072797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bc787f3f-23fd-4a1d-80c8-a05085868234 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:45.073243 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bc787f3f-23fd-4a1d-80c8-a05085868234 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:45.121903 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-00d30c24-94ab-44e4-8212-4e239c60c5bf tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:45.131675 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-00d30c24-94ab-44e4-8212-4e239c60c5bf tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1709 microversion: 2.1 time: 0.162113 Jun 22 17:04:45.132291 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 261/536] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:44 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:45.222840 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bc787f3f-23fd-4a1d-80c8-a05085868234 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:45.234625 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bc787f3f-23fd-4a1d-80c8-a05085868234 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.175427 Jun 22 17:04:45.234625 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 276/537] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:45 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:46.148728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7c67b89b-3e21-4a95-b59b-734d0152b4db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:46.149337 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7c67b89b-3e21-4a95-b59b-734d0152b4db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:46.156357 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7c67b89b-3e21-4a95-b59b-734d0152b4db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:46.156805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7c67b89b-3e21-4a95-b59b-734d0152b4db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:46.157564 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7c67b89b-3e21-4a95-b59b-734d0152b4db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:46.157998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7c67b89b-3e21-4a95-b59b-734d0152b4db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:46.249188 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f2d52148-3ced-444d-b757-aab63feec4e6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:46.250067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f2d52148-3ced-444d-b757-aab63feec4e6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:46.256545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f2d52148-3ced-444d-b757-aab63feec4e6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:46.257087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f2d52148-3ced-444d-b757-aab63feec4e6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:46.257866 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f2d52148-3ced-444d-b757-aab63feec4e6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:46.258294 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f2d52148-3ced-444d-b757-aab63feec4e6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:46.295184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7c67b89b-3e21-4a95-b59b-734d0152b4db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:46.303302 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7c67b89b-3e21-4a95-b59b-734d0152b4db tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1713 microversion: 2.1 time: 0.158370 Jun 22 17:04:46.303868 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 262/538] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:46 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:46.385884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f2d52148-3ced-444d-b757-aab63feec4e6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:46.394274 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f2d52148-3ced-444d-b757-aab63feec4e6 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.149160 Jun 22 17:04:46.394827 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 277/539] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:46 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:47.411780 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b44f05e1-afa6-4c1c-a542-fe0ce6929bd3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:47.412454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b44f05e1-afa6-4c1c-a542-fe0ce6929bd3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:47.418769 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b44f05e1-afa6-4c1c-a542-fe0ce6929bd3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:47.419209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b44f05e1-afa6-4c1c-a542-fe0ce6929bd3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:47.419957 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b44f05e1-afa6-4c1c-a542-fe0ce6929bd3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:47.420978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b44f05e1-afa6-4c1c-a542-fe0ce6929bd3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:47.548000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b44f05e1-afa6-4c1c-a542-fe0ce6929bd3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:47.555781 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b44f05e1-afa6-4c1c-a542-fe0ce6929bd3 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.148127 Jun 22 17:04:47.556362 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 263/540] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:47 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:48.571922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-62faaad6-f72d-47f6-9898-70f2e70804d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:48.572561 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-62faaad6-f72d-47f6-9898-70f2e70804d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:48.579508 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62faaad6-f72d-47f6-9898-70f2e70804d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:48.579960 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62faaad6-f72d-47f6-9898-70f2e70804d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:48.580754 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62faaad6-f72d-47f6-9898-70f2e70804d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:48.581193 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62faaad6-f72d-47f6-9898-70f2e70804d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:48.710738 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-62faaad6-f72d-47f6-9898-70f2e70804d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:48.715505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-62faaad6-f72d-47f6-9898-70f2e70804d7 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.147310 Jun 22 17:04:48.716134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 278/541] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:48 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:49.732503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8e83e2db-6791-4cf7-90e3-a6bba185007e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:49.733135 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8e83e2db-6791-4cf7-90e3-a6bba185007e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:49.739589 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e83e2db-6791-4cf7-90e3-a6bba185007e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:49.740041 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e83e2db-6791-4cf7-90e3-a6bba185007e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:49.740839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e83e2db-6791-4cf7-90e3-a6bba185007e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:49.741276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e83e2db-6791-4cf7-90e3-a6bba185007e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:49.865949 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8e83e2db-6791-4cf7-90e3-a6bba185007e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:49.874340 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8e83e2db-6791-4cf7-90e3-a6bba185007e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.145618 Jun 22 17:04:49.874892 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 264/542] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:49 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:50.891442 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-40d36a35-e551-437c-9496-7e4d02758aca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:50.892056 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-40d36a35-e551-437c-9496-7e4d02758aca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:50.898596 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-40d36a35-e551-437c-9496-7e4d02758aca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:50.899052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-40d36a35-e551-437c-9496-7e4d02758aca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:50.899820 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-40d36a35-e551-437c-9496-7e4d02758aca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:50.900295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-40d36a35-e551-437c-9496-7e4d02758aca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:51.030943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-40d36a35-e551-437c-9496-7e4d02758aca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:51.039151 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-40d36a35-e551-437c-9496-7e4d02758aca tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.152101 Jun 22 17:04:51.039712 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 279/543] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:50 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:52.056034 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-14da6c03-bb8f-47b2-aecb-821e1b51f2ea tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:52.056682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-14da6c03-bb8f-47b2-aecb-821e1b51f2ea tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:52.063112 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14da6c03-bb8f-47b2-aecb-821e1b51f2ea tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:52.063556 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14da6c03-bb8f-47b2-aecb-821e1b51f2ea tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:52.064350 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14da6c03-bb8f-47b2-aecb-821e1b51f2ea tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:52.064784 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14da6c03-bb8f-47b2-aecb-821e1b51f2ea tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:52.188308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-14da6c03-bb8f-47b2-aecb-821e1b51f2ea tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:52.196128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-14da6c03-bb8f-47b2-aecb-821e1b51f2ea tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.143881 Jun 22 17:04:52.196685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 265/544] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:52 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:53.214210 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7cef467f-14f4-430d-a748-6231ffc06948 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:53.221324 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7cef467f-14f4-430d-a748-6231ffc06948 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:53.221469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7cef467f-14f4-430d-a748-6231ffc06948 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:53.221807 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7cef467f-14f4-430d-a748-6231ffc06948 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:53.222724 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7cef467f-14f4-430d-a748-6231ffc06948 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:53.223200 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7cef467f-14f4-430d-a748-6231ffc06948 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:53.350319 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7cef467f-14f4-430d-a748-6231ffc06948 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:53.358300 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7cef467f-14f4-430d-a748-6231ffc06948 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.148339 Jun 22 17:04:53.358903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 280/545] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:53 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:54.375586 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3e5ec12a-c2dc-4496-a379-5466a8339f3a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:54.376256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3e5ec12a-c2dc-4496-a379-5466a8339f3a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:54.382592 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e5ec12a-c2dc-4496-a379-5466a8339f3a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:54.383039 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e5ec12a-c2dc-4496-a379-5466a8339f3a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:54.383850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e5ec12a-c2dc-4496-a379-5466a8339f3a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:54.384313 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e5ec12a-c2dc-4496-a379-5466a8339f3a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:54.740032 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3e5ec12a-c2dc-4496-a379-5466a8339f3a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:54.747892 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3e5ec12a-c2dc-4496-a379-5466a8339f3a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.376256 Jun 22 17:04:54.748487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 266/546] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:54 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:55.765659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7adf3de2-92df-4309-93ab-8a28b652ed0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:55.766864 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7adf3de2-92df-4309-93ab-8a28b652ed0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:55.773358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7adf3de2-92df-4309-93ab-8a28b652ed0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:55.773801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7adf3de2-92df-4309-93ab-8a28b652ed0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:55.774550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7adf3de2-92df-4309-93ab-8a28b652ed0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:55.774976 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7adf3de2-92df-4309-93ab-8a28b652ed0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:55.902602 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7adf3de2-92df-4309-93ab-8a28b652ed0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:55.911282 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7adf3de2-92df-4309-93ab-8a28b652ed0a tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.150353 Jun 22 17:04:55.911833 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 281/547] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:55 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:56.153446 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b3c260a0-3463-4807-a301-33b8463ede89 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:56.153974 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b3c260a0-3463-4807-a301-33b8463ede89 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:56.160648 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b3c260a0-3463-4807-a301-33b8463ede89 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:56.161101 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b3c260a0-3463-4807-a301-33b8463ede89 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:56.161868 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b3c260a0-3463-4807-a301-33b8463ede89 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:56.162302 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b3c260a0-3463-4807-a301-33b8463ede89 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:56.281892 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-b3c260a0-3463-4807-a301-33b8463ede89 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lazy-loading 'services' on Instance uuid 598ed68d-acfd-46be-9071-0904eabfcd91 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:04:56.545381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b3c260a0-3463-4807-a301-33b8463ede89 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "DELETE /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91/os-volume_attachments/74fbffdb-fc29-4b08-8974-3b22da8e2a8f" status: 202 len: 0 microversion: 2.1 time: 0.395633 Jun 22 17:04:56.545925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 267/548] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:04:56 2022] DELETE /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91/os-volume_attachments/74fbffdb-fc29-4b08-8974-3b22da8e2a8f => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:04:56.928941 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a12ea296-0545-40cd-a88a-785a5110989d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:56.929499 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a12ea296-0545-40cd-a88a-785a5110989d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:56.935824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a12ea296-0545-40cd-a88a-785a5110989d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:56.936963 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a12ea296-0545-40cd-a88a-785a5110989d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:56.937075 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a12ea296-0545-40cd-a88a-785a5110989d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:56.937472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a12ea296-0545-40cd-a88a-785a5110989d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:57.067730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a12ea296-0545-40cd-a88a-785a5110989d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:57.075668 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a12ea296-0545-40cd-a88a-785a5110989d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.150627 Jun 22 17:04:57.076259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 282/549] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:56 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:58.093767 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-56f9f66c-d75e-4cd8-a78d-6ed47ec48b0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:58.094458 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-56f9f66c-d75e-4cd8-a78d-6ed47ec48b0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:58.100851 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56f9f66c-d75e-4cd8-a78d-6ed47ec48b0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:58.101298 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56f9f66c-d75e-4cd8-a78d-6ed47ec48b0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:58.102052 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56f9f66c-d75e-4cd8-a78d-6ed47ec48b0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:58.102486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56f9f66c-d75e-4cd8-a78d-6ed47ec48b0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:58.243781 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-56f9f66c-d75e-4cd8-a78d-6ed47ec48b0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:58.252347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-56f9f66c-d75e-4cd8-a78d-6ed47ec48b0c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.163261 Jun 22 17:04:58.252914 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 268/550] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:58 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:04:58.715112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-93324290-1b57-4d30-9eca-eed8503c8edd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:58.715650 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-93324290-1b57-4d30-9eca-eed8503c8edd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:58.722681 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-93324290-1b57-4d30-9eca-eed8503c8edd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:58.723127 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-93324290-1b57-4d30-9eca-eed8503c8edd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:58.723887 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-93324290-1b57-4d30-9eca-eed8503c8edd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:58.724352 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-93324290-1b57-4d30-9eca-eed8503c8edd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:58.750095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-93324290-1b57-4d30-9eca-eed8503c8edd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:04:58.946431 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-93324290-1b57-4d30-9eca-eed8503c8edd tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "DELETE /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 204 len: 0 microversion: 2.1 time: 0.234711 Jun 22 17:04:58.946948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 283/551] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:04:58 2022] DELETE /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:04:58.955543 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5d6144f7-e28b-4e30-8267-4527da4d3b46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:58.956165 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5d6144f7-e28b-4e30-8267-4527da4d3b46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:58.962266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d6144f7-e28b-4e30-8267-4527da4d3b46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:58.962711 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d6144f7-e28b-4e30-8267-4527da4d3b46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:58.963465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d6144f7-e28b-4e30-8267-4527da4d3b46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:58.964005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d6144f7-e28b-4e30-8267-4527da4d3b46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:59.093130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5d6144f7-e28b-4e30-8267-4527da4d3b46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:59.101448 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5d6144f7-e28b-4e30-8267-4527da4d3b46 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1513 microversion: 2.1 time: 0.150234 Jun 22 17:04:59.102030 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 269/552] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:58 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:04:59.270619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-24a93dfb-f837-40b0-b749-bed2c8d83a84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:04:59.271271 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-24a93dfb-f837-40b0-b749-bed2c8d83a84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:04:59.277279 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-24a93dfb-f837-40b0-b749-bed2c8d83a84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:59.277728 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-24a93dfb-f837-40b0-b749-bed2c8d83a84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:59.278481 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-24a93dfb-f837-40b0-b749-bed2c8d83a84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:04:59.278914 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-24a93dfb-f837-40b0-b749-bed2c8d83a84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:04:59.405831 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-24a93dfb-f837-40b0-b749-bed2c8d83a84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:04:59.414435 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-24a93dfb-f837-40b0-b749-bed2c8d83a84 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.148642 Jun 22 17:04:59.414985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 284/553] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:04:59 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:00.118932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8fb3084c-fef4-44af-81f4-5f975984c002 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:00.119542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8fb3084c-fef4-44af-81f4-5f975984c002 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:00.126542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8fb3084c-fef4-44af-81f4-5f975984c002 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:00.126990 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8fb3084c-fef4-44af-81f4-5f975984c002 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:00.127747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8fb3084c-fef4-44af-81f4-5f975984c002 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:00.128247 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8fb3084c-fef4-44af-81f4-5f975984c002 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:00.251906 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8fb3084c-fef4-44af-81f4-5f975984c002 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:00.259424 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8fb3084c-fef4-44af-81f4-5f975984c002 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1513 microversion: 2.1 time: 0.144319 Jun 22 17:05:00.259986 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 270/554] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:00 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:00.432025 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8d71bb78-a217-4ecc-8404-27f6b6fc04f0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:00.432660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8d71bb78-a217-4ecc-8404-27f6b6fc04f0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:00.439759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8d71bb78-a217-4ecc-8404-27f6b6fc04f0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:00.440240 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8d71bb78-a217-4ecc-8404-27f6b6fc04f0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:00.440997 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8d71bb78-a217-4ecc-8404-27f6b6fc04f0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:00.441433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8d71bb78-a217-4ecc-8404-27f6b6fc04f0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:00.570634 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8d71bb78-a217-4ecc-8404-27f6b6fc04f0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:00.574062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:00.578762 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8d71bb78-a217-4ecc-8404-27f6b6fc04f0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.150569 Jun 22 17:05:00.579316 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 285/555] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:00 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:01.277085 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-60fa3abc-9e6f-45f5-bd08-7859861837be tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:01.277651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-60fa3abc-9e6f-45f5-bd08-7859861837be tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:01.284920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-60fa3abc-9e6f-45f5-bd08-7859861837be tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:01.285369 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-60fa3abc-9e6f-45f5-bd08-7859861837be tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:01.286128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-60fa3abc-9e6f-45f5-bd08-7859861837be tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:01.286560 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-60fa3abc-9e6f-45f5-bd08-7859861837be tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:01.303749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:01.421947 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-60fa3abc-9e6f-45f5-bd08-7859861837be tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:01.430073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-60fa3abc-9e6f-45f5-bd08-7859861837be tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1513 microversion: 2.1 time: 0.156960 Jun 22 17:05:01.433036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 271/556] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:01 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:01.600047 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3058fd1d-5d06-464a-a13c-b4edf644e3fd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:01.600685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3058fd1d-5d06-464a-a13c-b4edf644e3fd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:01.608699 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3058fd1d-5d06-464a-a13c-b4edf644e3fd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:01.609138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3058fd1d-5d06-464a-a13c-b4edf644e3fd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:01.610483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3058fd1d-5d06-464a-a13c-b4edf644e3fd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:01.610920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3058fd1d-5d06-464a-a13c-b4edf644e3fd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:01.737353 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3058fd1d-5d06-464a-a13c-b4edf644e3fd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:01.745131 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3058fd1d-5d06-464a-a13c-b4edf644e3fd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.148864 Jun 22 17:05:01.745694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 286/557] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:01 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:02.446790 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-34e324c6-6d2b-47ff-ae81-0320da6f964a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:02.447395 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-34e324c6-6d2b-47ff-ae81-0320da6f964a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:02.455161 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-34e324c6-6d2b-47ff-ae81-0320da6f964a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:02.455597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-34e324c6-6d2b-47ff-ae81-0320da6f964a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:02.456373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-34e324c6-6d2b-47ff-ae81-0320da6f964a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:02.456800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-34e324c6-6d2b-47ff-ae81-0320da6f964a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:02.583163 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-34e324c6-6d2b-47ff-ae81-0320da6f964a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:02.590468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-34e324c6-6d2b-47ff-ae81-0320da6f964a tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1513 microversion: 2.1 time: 0.147594 Jun 22 17:05:02.591019 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 272/558] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:02 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:02.762566 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a07768de-89f1-4caf-aaf1-9b1f1455e6cc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:02.763176 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a07768de-89f1-4caf-aaf1-9b1f1455e6cc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:02.770929 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a07768de-89f1-4caf-aaf1-9b1f1455e6cc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:02.771381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a07768de-89f1-4caf-aaf1-9b1f1455e6cc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:02.772340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a07768de-89f1-4caf-aaf1-9b1f1455e6cc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:02.772776 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a07768de-89f1-4caf-aaf1-9b1f1455e6cc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:02.958742 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a07768de-89f1-4caf-aaf1-9b1f1455e6cc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:02.966844 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a07768de-89f1-4caf-aaf1-9b1f1455e6cc tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.208491 Jun 22 17:05:02.967411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 287/559] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:02 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:03.336919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-cb9c60da-a697-4b71-9184-3d158d7ce3db req-3c5a8aec-2d7b-4e6f-a67e-e5faecb5f330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598ed68d-acfd-46be-9071-0904eabfcd91", "name": "network-vif-deleted", "tag": "be7fdef5-1db7-4cbb-b6d8-04757d6d68ab"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:05:03.345558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-cb9c60da-a697-4b71-9184-3d158d7ce3db req-3c5a8aec-2d7b-4e6f-a67e-e5faecb5f330 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:03.350083 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-cb9c60da-a697-4b71-9184-3d158d7ce3db req-3c5a8aec-2d7b-4e6f-a67e-e5faecb5f330 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:03.358670 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-cb9c60da-a697-4b71-9184-3d158d7ce3db req-3c5a8aec-2d7b-4e6f-a67e-e5faecb5f330 service nova] Creating event network-vif-deleted:be7fdef5-1db7-4cbb-b6d8-04757d6d68ab for instance 598ed68d-acfd-46be-9071-0904eabfcd91 on hv-cinder-81045 Jun 22 17:05:03.363595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-cb9c60da-a697-4b71-9184-3d158d7ce3db req-3c5a8aec-2d7b-4e6f-a67e-e5faecb5f330 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084361 Jun 22 17:05:03.364181 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 273/560] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:05:03.607027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9cb7f531-276b-4765-bc05-23cee16c91b7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:03.607634 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9cb7f531-276b-4765-bc05-23cee16c91b7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:03.613645 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9cb7f531-276b-4765-bc05-23cee16c91b7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:03.614093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9cb7f531-276b-4765-bc05-23cee16c91b7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:03.614853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9cb7f531-276b-4765-bc05-23cee16c91b7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:03.615286 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9cb7f531-276b-4765-bc05-23cee16c91b7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:03.678783 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9cb7f531-276b-4765-bc05-23cee16c91b7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:03.686307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9cb7f531-276b-4765-bc05-23cee16c91b7 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1304 microversion: 2.1 time: 0.083341 Jun 22 17:05:03.686888 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 288/561] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:03 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:03.985147 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-628fce2c-61ca-4c9d-a7ec-12e78b8b21b2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:03.985843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-628fce2c-61ca-4c9d-a7ec-12e78b8b21b2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:03.992254 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-628fce2c-61ca-4c9d-a7ec-12e78b8b21b2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:03.992710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-628fce2c-61ca-4c9d-a7ec-12e78b8b21b2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:03.993907 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-628fce2c-61ca-4c9d-a7ec-12e78b8b21b2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:03.994559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-628fce2c-61ca-4c9d-a7ec-12e78b8b21b2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:04.136579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-628fce2c-61ca-4c9d-a7ec-12e78b8b21b2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:04.146923 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-628fce2c-61ca-4c9d-a7ec-12e78b8b21b2 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1736 microversion: 2.1 time: 0.166356 Jun 22 17:05:04.147779 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 274/562] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:03 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:04.702682 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:04.703327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:04.709872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:04.710366 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:04.716298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:04.716298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:04.744445 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:04.744886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:04.745327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lazy-loading 'fault' on Instance uuid 598ed68d-acfd-46be-9071-0904eabfcd91 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:05:04.785842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa62b68f6704652b48d08fcba5e4798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b55c4096154398912c80d62bc2430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:04.793483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-04f992a0-3e74-4b08-878d-55790303c765 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 200 len: 1309 microversion: 2.1 time: 0.094563 Jun 22 17:05:04.797046 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 289/563] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:04 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:05.164426 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-166b7bea-81cf-463f-a8e3-8044fc869aa4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:05.164965 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-166b7bea-81cf-463f-a8e3-8044fc869aa4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:05.171433 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-166b7bea-81cf-463f-a8e3-8044fc869aa4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.171878 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-166b7bea-81cf-463f-a8e3-8044fc869aa4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.173317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-166b7bea-81cf-463f-a8e3-8044fc869aa4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.173749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-166b7bea-81cf-463f-a8e3-8044fc869aa4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.301381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-166b7bea-81cf-463f-a8e3-8044fc869aa4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:05.309525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-166b7bea-81cf-463f-a8e3-8044fc869aa4 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1716 microversion: 2.1 time: 0.148953 Jun 22 17:05:05.313477 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 275/564] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:05 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:05.369614 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:05.370102 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:05.376162 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.376606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.377353 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.377883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.457536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] HTTP exception thrown: Cannot 'detach_volume' instance b64220c7-ae61-46ea-ad86-122aee7e0a1a while it is in vm_state rescued Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Request method failure captured: Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: DELETE /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments/b47e8965-a575-47c3-9dac-ad7368a14ef2 HTTP/1.1 Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pRX08G0hDAHdLZrPBdOY8xLt6MLOfbdxcPdnme58g8-lvFRI7YFKpc3vw_491ML24LRnxReqb6g0LlTuMBL3nYFv0dP7LJfMpJIU77xspWSTdgdRGywdQNuMO8vL9o2Jynur21dIF6ucwSjsG5goigxgPFKASXjuvCPLvgveP2-TY Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:05:05.459133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 276147f205ae43da9df678dcd572115a Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:05:05.460778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Cannot 'detach_volume' instance b64220c7-ae61-46ea-ad86-122aee7e0a1a while it is in vm_state rescued Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'server_id': 'b64220c7-ae61-46ea-ad86-122aee7e0a1a', 'id': 'b47e8965-a575-47c3-9dac-ad7368a14ef2'} Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b64220c7-ae61-46ea-ad86-122aee7e0a1a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:05:05.461723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b64220c7-ae61-46ea-ad86-122aee7e0a1a while it is in vm_state rescued Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b64220c7-ae61-46ea-ad86-122aee7e0a1a while it is in vm_state rescued Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.463234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Returning 409 to user: Cannot 'detach_volume' instance b64220c7-ae61-46ea-ad86-122aee7e0a1a while it is in vm_state rescued {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:05:05.464480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-55baa97d-a314-4bf7-aa1e-9abc4a5dd335 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments/b47e8965-a575-47c3-9dac-ad7368a14ef2" status: 409 len: 152 microversion: 2.1 time: 0.095048 Jun 22 17:05:05.464480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 290/565] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:05:05 2022] DELETE /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments/b47e8965-a575-47c3-9dac-ad7368a14ef2 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 17:05:05.469430 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-40fa641c-c15f-4121-85d9-279bcaefc11c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:05:05.469982 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-40fa641c-c15f-4121-85d9-279bcaefc11c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:05.475858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40fa641c-c15f-4121-85d9-279bcaefc11c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.476525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40fa641c-c15f-4121-85d9-279bcaefc11c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.477279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40fa641c-c15f-4121-85d9-279bcaefc11c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.477708 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40fa641c-c15f-4121-85d9-279bcaefc11c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.669529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-40fa641c-c15f-4121-85d9-279bcaefc11c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "POST /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/action" status: 202 len: 0 microversion: 2.1 time: 0.203619 Jun 22 17:05:05.670459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 276/566] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:05:05 2022] POST /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 17:05:05.679705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-453efe01-cb27-45be-be4b-c7cabe0d3027 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:05.680502 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-453efe01-cb27-45be-be4b-c7cabe0d3027 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:05.686744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-453efe01-cb27-45be-be4b-c7cabe0d3027 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.687182 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-453efe01-cb27-45be-be4b-c7cabe0d3027 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.688593 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-453efe01-cb27-45be-be4b-c7cabe0d3027 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.689031 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-453efe01-cb27-45be-be4b-c7cabe0d3027 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.810828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:05.811861 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] [instance: 598ed68d-acfd-46be-9071-0904eabfcd91] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:05.818713 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.821054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.821054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:05.821054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:05.822638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-453efe01-cb27-45be-be4b-c7cabe0d3027 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:05.830943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-453efe01-cb27-45be-be4b-c7cabe0d3027 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1724 microversion: 2.1 time: 0.155777 Jun 22 17:05:05.831533 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 291/567] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:05 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:05:05.834454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] HTTP exception thrown: Instance 598ed68d-acfd-46be-9071-0904eabfcd91 could not be found. Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Request method failure captured: Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 HTTP/1.1 Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0rcMEkk8Z_Qv_JLdDY-pnbkPT-A2oI-SKUc-wtn-RqxvzUNZUr2xYe0RKnPb9TnlOCTdC_7T0NwroyHJg-k6tqvXc3NM6RKrIRzMphrJ8fcZkVfVvCDD9IxP_ueYBr4oAcWK1wUx79RSfRTsZUtI_ZOFjsghjlGZdFdhISkE0yruYU Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: d1b55c4096154398912c80d62bc2430b Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1017384273 Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:05:05.836072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d1b55c4096154398912c80d62bc2430b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d1b55c4096154398912c80d62bc2430b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d1b55c4096154398912c80d62bc2430b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d1b55c4096154398912c80d62bc2430b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesSnapshotTestJSON-1017384273 Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: d1b55c4096154398912c80d62bc2430b Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1017384273 Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesSnapshotTestJSON-1017384273-project Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: eaa62b68f6704652b48d08fcba5e4798 Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesSnapshotTestJSON-1017384273-project Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 598ed68d-acfd-46be-9071-0904eabfcd91 could not be found. Jun 22 17:05:05.837665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '598ed68d-acfd-46be-9071-0904eabfcd91'} Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598ed68d-acfd-46be-9071-0904eabfcd91 could not be found. Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:05:05.838667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598ed68d-acfd-46be-9071-0904eabfcd91 could not be found. Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598ed68d-acfd-46be-9071-0904eabfcd91 could not be found. Jun 22 17:05:05.840098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:05:05.841425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] Returning 404 to user: Instance 598ed68d-acfd-46be-9071-0904eabfcd91 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:05:05.841425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e60a5028-0e23-4bcd-adc2-379bad59cb79 tempest-VolumesSnapshotTestJSON-1017384273 tempest-VolumesSnapshotTestJSON-1017384273-project] 10.222.0.18 "GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91" status: 404 len: 111 microversion: 2.1 time: 0.031390 Jun 22 17:05:05.841425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 277/568] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:05 2022] GET /compute/v2.1/servers/598ed68d-acfd-46be-9071-0904eabfcd91 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:05:06.848416 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b228ff6e-b62e-4a32-8cd9-2aea68f26e59 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:06.849030 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b228ff6e-b62e-4a32-8cd9-2aea68f26e59 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:06.855377 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b228ff6e-b62e-4a32-8cd9-2aea68f26e59 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:06.855818 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b228ff6e-b62e-4a32-8cd9-2aea68f26e59 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:06.856590 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b228ff6e-b62e-4a32-8cd9-2aea68f26e59 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:06.857019 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b228ff6e-b62e-4a32-8cd9-2aea68f26e59 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:06.983926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b228ff6e-b62e-4a32-8cd9-2aea68f26e59 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:06.992612 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b228ff6e-b62e-4a32-8cd9-2aea68f26e59 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1724 microversion: 2.1 time: 0.147870 Jun 22 17:05:06.992964 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 292/569] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:06 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:08.010244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cc012e1b-f347-4169-8210-ad0fc865406b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:08.010884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cc012e1b-f347-4169-8210-ad0fc865406b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:08.017438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc012e1b-f347-4169-8210-ad0fc865406b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:08.017884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc012e1b-f347-4169-8210-ad0fc865406b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:08.018643 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc012e1b-f347-4169-8210-ad0fc865406b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:08.019081 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc012e1b-f347-4169-8210-ad0fc865406b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:08.146938 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cc012e1b-f347-4169-8210-ad0fc865406b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:08.154897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cc012e1b-f347-4169-8210-ad0fc865406b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1724 microversion: 2.1 time: 0.148508 Jun 22 17:05:08.155454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 278/570] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:08 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:05:09.172771 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ddc52fd7-7724-4ad1-9745-4781a421ef7b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:09.173373 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ddc52fd7-7724-4ad1-9745-4781a421ef7b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:09.179818 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ddc52fd7-7724-4ad1-9745-4781a421ef7b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:09.180307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ddc52fd7-7724-4ad1-9745-4781a421ef7b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:09.181059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ddc52fd7-7724-4ad1-9745-4781a421ef7b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:09.181485 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ddc52fd7-7724-4ad1-9745-4781a421ef7b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:09.314798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ddc52fd7-7724-4ad1-9745-4781a421ef7b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:09.322917 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ddc52fd7-7724-4ad1-9745-4781a421ef7b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1724 microversion: 2.1 time: 0.153941 Jun 22 17:05:09.329639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 293/571] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:09 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:10.339535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-116ed895-5381-4f19-b38c-f480084e8893 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:10.340079 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-116ed895-5381-4f19-b38c-f480084e8893 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:10.347197 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-116ed895-5381-4f19-b38c-f480084e8893 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:10.347647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-116ed895-5381-4f19-b38c-f480084e8893 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:10.348433 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-116ed895-5381-4f19-b38c-f480084e8893 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:10.348871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-116ed895-5381-4f19-b38c-f480084e8893 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:10.478359 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-116ed895-5381-4f19-b38c-f480084e8893 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:10.486126 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-116ed895-5381-4f19-b38c-f480084e8893 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1730 microversion: 2.1 time: 0.150459 Jun 22 17:05:10.486670 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 279/572] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:10 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:10.502569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-555a280c-70b8-42b6-a4f3-cf24107c9e62 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:10.506584 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-555a280c-70b8-42b6-a4f3-cf24107c9e62 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:10.509506 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-555a280c-70b8-42b6-a4f3-cf24107c9e62 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:10.509955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-555a280c-70b8-42b6-a4f3-cf24107c9e62 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:10.510717 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-555a280c-70b8-42b6-a4f3-cf24107c9e62 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:10.511152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-555a280c-70b8-42b6-a4f3-cf24107c9e62 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:10.586833 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-555a280c-70b8-42b6-a4f3-cf24107c9e62 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088511 Jun 22 17:05:10.587420 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 294/573] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 17:05:10 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:05:11.745294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-711a3958-47b7-4342-bc2c-4633bc9f84a5 req-0937663d-f61d-46ab-b1ed-e40339c04c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64220c7-ae61-46ea-ad86-122aee7e0a1a", "tag": "fcd6efe8-f80c-4c03-84a9-bd2560f1f166"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:05:11.753256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-711a3958-47b7-4342-bc2c-4633bc9f84a5 req-0937663d-f61d-46ab-b1ed-e40339c04c6d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:11.753693 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-711a3958-47b7-4342-bc2c-4633bc9f84a5 req-0937663d-f61d-46ab-b1ed-e40339c04c6d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:11.765991 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-711a3958-47b7-4342-bc2c-4633bc9f84a5 req-0937663d-f61d-46ab-b1ed-e40339c04c6d service nova] Creating event network-changed:fcd6efe8-f80c-4c03-84a9-bd2560f1f166 for instance b64220c7-ae61-46ea-ad86-122aee7e0a1a on hv-cinder-81045 Jun 22 17:05:11.771486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-711a3958-47b7-4342-bc2c-4633bc9f84a5 req-0937663d-f61d-46ab-b1ed-e40339c04c6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085583 Jun 22 17:05:11.772070 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 280/574] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:05:13.787752 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-c97d2615-6f1b-4915-aeeb-fd1316dade6c req-4f69af13-d134-4a8f-9348-d3b765a7c3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64220c7-ae61-46ea-ad86-122aee7e0a1a", "tag": "fcd6efe8-f80c-4c03-84a9-bd2560f1f166"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:05:13.796726 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-c97d2615-6f1b-4915-aeeb-fd1316dade6c req-4f69af13-d134-4a8f-9348-d3b765a7c3aa service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:13.797168 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-c97d2615-6f1b-4915-aeeb-fd1316dade6c req-4f69af13-d134-4a8f-9348-d3b765a7c3aa service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:13.807880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-c97d2615-6f1b-4915-aeeb-fd1316dade6c req-4f69af13-d134-4a8f-9348-d3b765a7c3aa service nova] Creating event network-changed:fcd6efe8-f80c-4c03-84a9-bd2560f1f166 for instance b64220c7-ae61-46ea-ad86-122aee7e0a1a on hv-cinder-81045 Jun 22 17:05:13.812885 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-c97d2615-6f1b-4915-aeeb-fd1316dade6c req-4f69af13-d134-4a8f-9348-d3b765a7c3aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029547 Jun 22 17:05:13.813435 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 295/575] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:05:49.288669 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=41 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:49.289296 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:49.293401 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8e5fd5b0-d059-4530-84df-95717757649d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:05:49.294436 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8e5fd5b0-d059-4530-84df-95717757649d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:49.301046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e5fd5b0-d059-4530-84df-95717757649d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:49.302421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e5fd5b0-d059-4530-84df-95717757649d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:49.302421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e5fd5b0-d059-4530-84df-95717757649d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:49.302755 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e5fd5b0-d059-4530-84df-95717757649d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:49.539007 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8e5fd5b0-d059-4530-84df-95717757649d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "POST /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/action" status: 202 len: 0 microversion: 2.1 time: 0.251928 Jun 22 17:05:49.539790 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 281/576] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:05:49 2022] POST /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:05:49.545747 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:49.546496 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=56 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:49.550842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bcf16d99-476f-43e9-a4c4-de264f9c2294 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:49.551546 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bcf16d99-476f-43e9-a4c4-de264f9c2294 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:49.557876 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bcf16d99-476f-43e9-a4c4-de264f9c2294 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:49.558313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bcf16d99-476f-43e9-a4c4-de264f9c2294 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:49.559080 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bcf16d99-476f-43e9-a4c4-de264f9c2294 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:49.559507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bcf16d99-476f-43e9-a4c4-de264f9c2294 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:49.701252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bcf16d99-476f-43e9-a4c4-de264f9c2294 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:49.709980 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bcf16d99-476f-43e9-a4c4-de264f9c2294 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1749 microversion: 2.1 time: 0.165997 Jun 22 17:05:49.710546 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 296/577] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:49 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:50.728419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-56dfcf10-3092-46c0-b5a1-ec041842299a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:50.729111 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-56dfcf10-3092-46c0-b5a1-ec041842299a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:50.735419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56dfcf10-3092-46c0-b5a1-ec041842299a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:50.735861 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56dfcf10-3092-46c0-b5a1-ec041842299a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:50.736648 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56dfcf10-3092-46c0-b5a1-ec041842299a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:50.737079 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56dfcf10-3092-46c0-b5a1-ec041842299a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:50.878055 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-56dfcf10-3092-46c0-b5a1-ec041842299a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:50.885916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-56dfcf10-3092-46c0-b5a1-ec041842299a tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.162314 Jun 22 17:05:50.886508 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 282/578] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:50 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:51.903755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8beb5676-470b-492a-94ed-c89a7858bba9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:51.904507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8beb5676-470b-492a-94ed-c89a7858bba9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:51.912135 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8beb5676-470b-492a-94ed-c89a7858bba9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:51.912565 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8beb5676-470b-492a-94ed-c89a7858bba9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:51.913311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8beb5676-470b-492a-94ed-c89a7858bba9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:51.913737 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8beb5676-470b-492a-94ed-c89a7858bba9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:52.059910 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8beb5676-470b-492a-94ed-c89a7858bba9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:52.068286 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8beb5676-470b-492a-94ed-c89a7858bba9 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.168297 Jun 22 17:05:52.068842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 297/579] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:51 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:53.085541 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-34d93fc9-6dd7-4a43-962c-5c706d790bc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:53.086152 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-34d93fc9-6dd7-4a43-962c-5c706d790bc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:53.092590 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-34d93fc9-6dd7-4a43-962c-5c706d790bc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:53.093027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-34d93fc9-6dd7-4a43-962c-5c706d790bc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:53.093816 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-34d93fc9-6dd7-4a43-962c-5c706d790bc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:53.094242 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-34d93fc9-6dd7-4a43-962c-5c706d790bc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:53.235301 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-34d93fc9-6dd7-4a43-962c-5c706d790bc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:53.243156 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-34d93fc9-6dd7-4a43-962c-5c706d790bc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.161654 Jun 22 17:05:53.243733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 283/580] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:53 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:54.259779 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e82934e0-a075-426d-b001-594d0d14e77d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:54.260344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e82934e0-a075-426d-b001-594d0d14e77d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:54.266771 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e82934e0-a075-426d-b001-594d0d14e77d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:54.267220 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e82934e0-a075-426d-b001-594d0d14e77d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:54.267973 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e82934e0-a075-426d-b001-594d0d14e77d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:54.268439 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e82934e0-a075-426d-b001-594d0d14e77d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:54.405568 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e82934e0-a075-426d-b001-594d0d14e77d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:54.414440 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e82934e0-a075-426d-b001-594d0d14e77d tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.158536 Jun 22 17:05:54.415002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 298/581] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:54 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:55.430581 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8753e850-cd5e-4840-ae9a-99c59ece151c tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:55.431193 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8753e850-cd5e-4840-ae9a-99c59ece151c tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:55.437317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8753e850-cd5e-4840-ae9a-99c59ece151c tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:55.437772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8753e850-cd5e-4840-ae9a-99c59ece151c tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:55.438530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8753e850-cd5e-4840-ae9a-99c59ece151c tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:55.438967 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8753e850-cd5e-4840-ae9a-99c59ece151c tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:55.574824 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8753e850-cd5e-4840-ae9a-99c59ece151c tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:55.583126 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8753e850-cd5e-4840-ae9a-99c59ece151c tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.155951 Jun 22 17:05:55.583685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 284/582] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:55 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:56.599848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9aa2672c-a32c-42b2-8934-6e7c4742ecc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:56.600518 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9aa2672c-a32c-42b2-8934-6e7c4742ecc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:56.606994 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9aa2672c-a32c-42b2-8934-6e7c4742ecc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:56.607440 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9aa2672c-a32c-42b2-8934-6e7c4742ecc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:56.608224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9aa2672c-a32c-42b2-8934-6e7c4742ecc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:56.608658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9aa2672c-a32c-42b2-8934-6e7c4742ecc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:56.745704 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9aa2672c-a32c-42b2-8934-6e7c4742ecc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:56.753590 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9aa2672c-a32c-42b2-8934-6e7c4742ecc4 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.157558 Jun 22 17:05:56.754153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 299/583] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:56 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:57.771186 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9e5f004d-7d0b-42a7-b7b7-990abc013246 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:57.771791 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9e5f004d-7d0b-42a7-b7b7-990abc013246 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:57.778276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9e5f004d-7d0b-42a7-b7b7-990abc013246 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:57.778716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9e5f004d-7d0b-42a7-b7b7-990abc013246 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:57.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9e5f004d-7d0b-42a7-b7b7-990abc013246 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:57.779892 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9e5f004d-7d0b-42a7-b7b7-990abc013246 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:57.919865 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9e5f004d-7d0b-42a7-b7b7-990abc013246 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:57.928347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9e5f004d-7d0b-42a7-b7b7-990abc013246 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.160880 Jun 22 17:05:57.928953 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 285/584] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:57 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:05:58.190148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:05:58.190683 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:05:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:05:58.945862 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-21446fd5-29f8-4c46-91a4-efbc44fc3b78 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:05:58.946424 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-21446fd5-29f8-4c46-91a4-efbc44fc3b78 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:05:58.953383 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-21446fd5-29f8-4c46-91a4-efbc44fc3b78 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:58.953831 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-21446fd5-29f8-4c46-91a4-efbc44fc3b78 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:58.954592 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-21446fd5-29f8-4c46-91a4-efbc44fc3b78 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:05:58.955026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-21446fd5-29f8-4c46-91a4-efbc44fc3b78 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:05:59.097262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-21446fd5-29f8-4c46-91a4-efbc44fc3b78 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:05:59.105207 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-21446fd5-29f8-4c46-91a4-efbc44fc3b78 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.163841 Jun 22 17:05:59.105757 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 300/585] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:05:58 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:00.122645 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-445c7198-4852-42a9-a4bc-44a4154ba545 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:00.123246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-445c7198-4852-42a9-a4bc-44a4154ba545 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:00.129912 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-445c7198-4852-42a9-a4bc-44a4154ba545 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:00.130351 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-445c7198-4852-42a9-a4bc-44a4154ba545 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:00.131129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-445c7198-4852-42a9-a4bc-44a4154ba545 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:00.131554 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-445c7198-4852-42a9-a4bc-44a4154ba545 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:00.267801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-445c7198-4852-42a9-a4bc-44a4154ba545 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:00.276248 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-445c7198-4852-42a9-a4bc-44a4154ba545 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.157433 Jun 22 17:06:00.276744 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 286/586] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:00 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:01.292636 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a8880945-e091-4cd3-9279-954240b8d089 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:01.293155 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a8880945-e091-4cd3-9279-954240b8d089 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:01.299657 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8880945-e091-4cd3-9279-954240b8d089 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:01.300129 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8880945-e091-4cd3-9279-954240b8d089 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:01.300889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8880945-e091-4cd3-9279-954240b8d089 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:01.301914 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a8880945-e091-4cd3-9279-954240b8d089 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:01.450679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a8880945-e091-4cd3-9279-954240b8d089 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:01.460503 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a8880945-e091-4cd3-9279-954240b8d089 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1754 microversion: 2.1 time: 0.171654 Jun 22 17:06:01.461060 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 301/587] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:01 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:02.478137 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-445ab1c6-1740-41df-99c5-bd37f3790e14 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:02.478734 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-445ab1c6-1740-41df-99c5-bd37f3790e14 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:02.485119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-445ab1c6-1740-41df-99c5-bd37f3790e14 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:02.485558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-445ab1c6-1740-41df-99c5-bd37f3790e14 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:02.486303 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-445ab1c6-1740-41df-99c5-bd37f3790e14 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:02.486735 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-445ab1c6-1740-41df-99c5-bd37f3790e14 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:02.643559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-445ab1c6-1740-41df-99c5-bd37f3790e14 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:02.644801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-445ab1c6-1740-41df-99c5-bd37f3790e14 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1757 microversion: 2.1 time: 0.170911 Jun 22 17:06:02.645375 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 287/588] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:02 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:05.897506 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-54629a05-d63f-42a0-a693-562829a2aaf0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:05.898059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-54629a05-d63f-42a0-a693-562829a2aaf0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:05.903939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-54629a05-d63f-42a0-a693-562829a2aaf0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:05.904425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-54629a05-d63f-42a0-a693-562829a2aaf0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:05.905198 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-54629a05-d63f-42a0-a693-562829a2aaf0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:05.905633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-54629a05-d63f-42a0-a693-562829a2aaf0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:05.983051 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-54629a05-d63f-42a0-a693-562829a2aaf0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lazy-loading 'services' on Instance uuid 5168389e-f141-4e31-9c66-a365b612cd02 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:06:06.231448 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-54629a05-d63f-42a0-a693-562829a2aaf0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/os-volume_attachments/612a6794-a3db-4828-99aa-4a768eec32ff" status: 202 len: 0 microversion: 2.1 time: 0.553537 Jun 22 17:06:06.232069 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 302/589] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:06:05 2022] DELETE /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/os-volume_attachments/612a6794-a3db-4828-99aa-4a768eec32ff => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:06:08.392488 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4134c35d-89a5-4b05-930b-c84535fb2b3d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:06:08.398844 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4134c35d-89a5-4b05-930b-c84535fb2b3d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:08.399292 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4134c35d-89a5-4b05-930b-c84535fb2b3d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:08.420841 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4134c35d-89a5-4b05-930b-c84535fb2b3d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Going to try to stop instance {{(pid=118472) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 17:06:08.566182 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4134c35d-89a5-4b05-930b-c84535fb2b3d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/action" status: 202 len: 0 microversion: 2.1 time: 0.177424 Jun 22 17:06:08.566939 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 288/590] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:06:08 2022] POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:06:08.576501 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-149d1b83-d9a3-42b0-9721-80c2bee59f9c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:08.577337 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-149d1b83-d9a3-42b0-9721-80c2bee59f9c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:08.583583 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-149d1b83-d9a3-42b0-9721-80c2bee59f9c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:08.584024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-149d1b83-d9a3-42b0-9721-80c2bee59f9c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:08.584819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-149d1b83-d9a3-42b0-9721-80c2bee59f9c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:08.585248 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-149d1b83-d9a3-42b0-9721-80c2bee59f9c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:08.715163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-149d1b83-d9a3-42b0-9721-80c2bee59f9c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:08.722684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-149d1b83-d9a3-42b0-9721-80c2bee59f9c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.151278 Jun 22 17:06:08.723246 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 303/591] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:08 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:09.741507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2c5515a1-6d2f-45d7-8688-62a2d4464195 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:09.742241 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2c5515a1-6d2f-45d7-8688-62a2d4464195 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:09.748868 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c5515a1-6d2f-45d7-8688-62a2d4464195 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:09.749323 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c5515a1-6d2f-45d7-8688-62a2d4464195 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:09.750090 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c5515a1-6d2f-45d7-8688-62a2d4464195 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:09.750530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c5515a1-6d2f-45d7-8688-62a2d4464195 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:09.876157 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2c5515a1-6d2f-45d7-8688-62a2d4464195 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:09.884183 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2c5515a1-6d2f-45d7-8688-62a2d4464195 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.147507 Jun 22 17:06:09.884739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 289/592] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:09 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:09.951922 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:06:09.952068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:06:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:06:10.901405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-dafc6cad-2356-4126-82eb-a2cd25b57547 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:10.902015 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-dafc6cad-2356-4126-82eb-a2cd25b57547 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:10.909361 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dafc6cad-2356-4126-82eb-a2cd25b57547 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:10.909734 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dafc6cad-2356-4126-82eb-a2cd25b57547 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:10.910738 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dafc6cad-2356-4126-82eb-a2cd25b57547 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:10.911165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dafc6cad-2356-4126-82eb-a2cd25b57547 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:11.038634 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-dafc6cad-2356-4126-82eb-a2cd25b57547 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:11.046045 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-dafc6cad-2356-4126-82eb-a2cd25b57547 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.148546 Jun 22 17:06:11.046605 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 304/593] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:10 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:12.062850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c5d4c384-725c-43f9-9828-be4cace8bc46 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:12.063454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c5d4c384-725c-43f9-9828-be4cace8bc46 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:12.070754 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5d4c384-725c-43f9-9828-be4cace8bc46 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:12.071196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5d4c384-725c-43f9-9828-be4cace8bc46 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:12.071942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5d4c384-725c-43f9-9828-be4cace8bc46 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:12.072398 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5d4c384-725c-43f9-9828-be4cace8bc46 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:12.196199 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5d4c384-725c-43f9-9828-be4cace8bc46 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:12.203430 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c5d4c384-725c-43f9-9828-be4cace8bc46 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.144378 Jun 22 17:06:12.203974 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 290/594] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:12 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:13.219539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-967656c2-5b96-49fe-8ac7-c1cb69bb35eb tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:13.220174 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-967656c2-5b96-49fe-8ac7-c1cb69bb35eb tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:13.226740 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-967656c2-5b96-49fe-8ac7-c1cb69bb35eb tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:13.227186 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-967656c2-5b96-49fe-8ac7-c1cb69bb35eb tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:13.227940 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-967656c2-5b96-49fe-8ac7-c1cb69bb35eb tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:13.228408 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-967656c2-5b96-49fe-8ac7-c1cb69bb35eb tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:13.355225 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-967656c2-5b96-49fe-8ac7-c1cb69bb35eb tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:13.362574 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-967656c2-5b96-49fe-8ac7-c1cb69bb35eb tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.146828 Jun 22 17:06:13.363135 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 305/595] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:13 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:14.380387 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0ce9b864-32d0-4ce6-88c2-650db9de0596 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:14.381008 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0ce9b864-32d0-4ce6-88c2-650db9de0596 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:14.387937 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0ce9b864-32d0-4ce6-88c2-650db9de0596 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:14.388412 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0ce9b864-32d0-4ce6-88c2-650db9de0596 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:14.389168 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0ce9b864-32d0-4ce6-88c2-650db9de0596 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:14.389608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0ce9b864-32d0-4ce6-88c2-650db9de0596 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:14.518006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0ce9b864-32d0-4ce6-88c2-650db9de0596 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:14.526382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0ce9b864-32d0-4ce6-88c2-650db9de0596 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.149912 Jun 22 17:06:14.526934 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 291/596] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:14 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:15.543903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a4b10e7c-4d78-45d1-80c3-4c84f26a9dd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:15.544547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a4b10e7c-4d78-45d1-80c3-4c84f26a9dd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:15.550918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a4b10e7c-4d78-45d1-80c3-4c84f26a9dd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:15.551358 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a4b10e7c-4d78-45d1-80c3-4c84f26a9dd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:15.552123 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a4b10e7c-4d78-45d1-80c3-4c84f26a9dd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:15.552559 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a4b10e7c-4d78-45d1-80c3-4c84f26a9dd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:15.677213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a4b10e7c-4d78-45d1-80c3-4c84f26a9dd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:15.684619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a4b10e7c-4d78-45d1-80c3-4c84f26a9dd3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.144485 Jun 22 17:06:15.692626 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 306/597] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:15 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:16.701750 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cf3f1ad7-fa7d-4d88-8c50-16e711df08d7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:16.702367 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cf3f1ad7-fa7d-4d88-8c50-16e711df08d7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:16.708729 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf3f1ad7-fa7d-4d88-8c50-16e711df08d7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:16.709171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf3f1ad7-fa7d-4d88-8c50-16e711df08d7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:16.709977 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf3f1ad7-fa7d-4d88-8c50-16e711df08d7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:16.710406 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf3f1ad7-fa7d-4d88-8c50-16e711df08d7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:16.836245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cf3f1ad7-fa7d-4d88-8c50-16e711df08d7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:16.843651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cf3f1ad7-fa7d-4d88-8c50-16e711df08d7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.145644 Jun 22 17:06:16.844253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 292/598] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:16 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:17.860972 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d4554d9f-b138-4626-b694-bf3a3bb7eda7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:17.861581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d4554d9f-b138-4626-b694-bf3a3bb7eda7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:17.868620 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d4554d9f-b138-4626-b694-bf3a3bb7eda7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:17.869067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d4554d9f-b138-4626-b694-bf3a3bb7eda7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:17.869822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d4554d9f-b138-4626-b694-bf3a3bb7eda7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:17.870252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d4554d9f-b138-4626-b694-bf3a3bb7eda7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:17.999397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d4554d9f-b138-4626-b694-bf3a3bb7eda7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:18.007515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d4554d9f-b138-4626-b694-bf3a3bb7eda7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.150311 Jun 22 17:06:18.008074 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 307/599] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:17 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:18.244931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-47566e1c-7367-4fb9-b06c-760faa01a463 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:18.250842 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-47566e1c-7367-4fb9-b06c-760faa01a463 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:18.251712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-47566e1c-7367-4fb9-b06c-760faa01a463 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:18.252188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-47566e1c-7367-4fb9-b06c-760faa01a463 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:18.252938 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-47566e1c-7367-4fb9-b06c-760faa01a463 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:18.253364 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-47566e1c-7367-4fb9-b06c-760faa01a463 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:18.333619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-47566e1c-7367-4fb9-b06c-760faa01a463 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lazy-loading 'services' on Instance uuid b64220c7-ae61-46ea-ad86-122aee7e0a1a {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:06:18.545373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-47566e1c-7367-4fb9-b06c-760faa01a463 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments/b47e8965-a575-47c3-9dac-ad7368a14ef2" status: 202 len: 0 microversion: 2.1 time: 0.304800 Jun 22 17:06:18.546317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 293/600] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:06:18 2022] DELETE /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments/b47e8965-a575-47c3-9dac-ad7368a14ef2 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:06:18.555721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-042f36a4-8cf5-4e4a-955f-44b4ee17905b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:18.558669 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-042f36a4-8cf5-4e4a-955f-44b4ee17905b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:18.562614 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-042f36a4-8cf5-4e4a-955f-44b4ee17905b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:18.563044 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-042f36a4-8cf5-4e4a-955f-44b4ee17905b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:18.563796 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-042f36a4-8cf5-4e4a-955f-44b4ee17905b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:18.564259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-042f36a4-8cf5-4e4a-955f-44b4ee17905b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:18.592977 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-042f36a4-8cf5-4e4a-955f-44b4ee17905b tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Jun 22 17:06:18.593514 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 308/601] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:06:18 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:06:19.025558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b0dd59f1-e6b7-4982-8fc5-be71c2341cb5 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:19.025926 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b0dd59f1-e6b7-4982-8fc5-be71c2341cb5 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:19.032231 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b0dd59f1-e6b7-4982-8fc5-be71c2341cb5 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:19.032684 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b0dd59f1-e6b7-4982-8fc5-be71c2341cb5 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:19.033850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b0dd59f1-e6b7-4982-8fc5-be71c2341cb5 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:19.034599 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b0dd59f1-e6b7-4982-8fc5-be71c2341cb5 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:19.174713 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b0dd59f1-e6b7-4982-8fc5-be71c2341cb5 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:19.178786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:19.183019 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b0dd59f1-e6b7-4982-8fc5-be71c2341cb5 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1677 microversion: 2.1 time: 0.162031 Jun 22 17:06:19.183574 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 294/602] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:19 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:19.605280 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-68eb48dc-5ef4-46ed-91d5-437ffe6f14a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:19.606263 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-68eb48dc-5ef4-46ed-91d5-437ffe6f14a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:19.612696 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68eb48dc-5ef4-46ed-91d5-437ffe6f14a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:19.613137 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68eb48dc-5ef4-46ed-91d5-437ffe6f14a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:19.613891 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68eb48dc-5ef4-46ed-91d5-437ffe6f14a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:19.614320 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68eb48dc-5ef4-46ed-91d5-437ffe6f14a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:19.642474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-68eb48dc-5ef4-46ed-91d5-437ffe6f14a0 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Jun 22 17:06:19.643013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 309/603] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:06:19 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:06:20.200545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-acdb9e3b-b4e4-4826-ac68-46dd83252b1f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:20.201159 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-acdb9e3b-b4e4-4826-ac68-46dd83252b1f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:20.203707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=29 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:20.208647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acdb9e3b-b4e4-4826-ac68-46dd83252b1f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.213908 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acdb9e3b-b4e4-4826-ac68-46dd83252b1f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.213908 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acdb9e3b-b4e4-4826-ac68-46dd83252b1f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.213908 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acdb9e3b-b4e4-4826-ac68-46dd83252b1f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.336614 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-acdb9e3b-b4e4-4826-ac68-46dd83252b1f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:20.343897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-acdb9e3b-b4e4-4826-ac68-46dd83252b1f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1654 microversion: 2.1 time: 0.147261 Jun 22 17:06:20.344491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 295/604] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:20 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:20.360573 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-854871fc-1480-4655-ba05-75a944a1670b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:06:20.366489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-854871fc-1480-4655-ba05-75a944a1670b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.367562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-854871fc-1480-4655-ba05-75a944a1670b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.392391 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:20.428096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-854871fc-1480-4655-ba05-75a944a1670b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Going to try to start instance {{(pid=118471) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 17:06:20.640182 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-854871fc-1480-4655-ba05-75a944a1670b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/action" status: 202 len: 0 microversion: 2.1 time: 0.283241 Jun 22 17:06:20.640981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 310/605] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:06:20 2022] POST /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:06:20.648996 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-578c9b37-c7a8-42be-ae9b-ee33a889808a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:20.649642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-578c9b37-c7a8-42be-ae9b-ee33a889808a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:20.654167 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-dc208b1c-1a6c-4095-946f-e2cacb75bc69 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:20.655232 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-dc208b1c-1a6c-4095-946f-e2cacb75bc69 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:20.655681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-578c9b37-c7a8-42be-ae9b-ee33a889808a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.656154 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-578c9b37-c7a8-42be-ae9b-ee33a889808a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.665721 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-578c9b37-c7a8-42be-ae9b-ee33a889808a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.665721 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-578c9b37-c7a8-42be-ae9b-ee33a889808a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.666802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dc208b1c-1a6c-4095-946f-e2cacb75bc69 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.666802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dc208b1c-1a6c-4095-946f-e2cacb75bc69 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.666802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dc208b1c-1a6c-4095-946f-e2cacb75bc69 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.666802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dc208b1c-1a6c-4095-946f-e2cacb75bc69 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.692959 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-dc208b1c-1a6c-4095-946f-e2cacb75bc69 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043013 Jun 22 17:06:20.693513 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 311/606] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:06:20 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 17:06:20.765334 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-01b35f12-c5f3-4734-874a-368ccfd600fa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:20.765832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-01b35f12-c5f3-4734-874a-368ccfd600fa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:20.772032 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01b35f12-c5f3-4734-874a-368ccfd600fa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.772514 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01b35f12-c5f3-4734-874a-368ccfd600fa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.773790 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01b35f12-c5f3-4734-874a-368ccfd600fa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:20.774219 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-01b35f12-c5f3-4734-874a-368ccfd600fa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:20.799089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-578c9b37-c7a8-42be-ae9b-ee33a889808a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:20.799533 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-01b35f12-c5f3-4734-874a-368ccfd600fa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:06:20.807092 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-578c9b37-c7a8-42be-ae9b-ee33a889808a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1663 microversion: 2.1 time: 0.161885 Jun 22 17:06:20.816931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 296/607] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:20 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:21.071919 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-01b35f12-c5f3-4734-874a-368ccfd600fa tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 204 len: 0 microversion: 2.1 time: 0.310108 Jun 22 17:06:21.072544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 312/608] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:06:20 2022] DELETE /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 17:06:21.080581 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7772410-5324-4979-9f64-977b0ce90c92 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:21.086021 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7772410-5324-4979-9f64-977b0ce90c92 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:21.088917 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7772410-5324-4979-9f64-977b0ce90c92 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:21.089368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7772410-5324-4979-9f64-977b0ce90c92 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:21.090130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7772410-5324-4979-9f64-977b0ce90c92 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:21.090561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7772410-5324-4979-9f64-977b0ce90c92 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:21.216635 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d7772410-5324-4979-9f64-977b0ce90c92 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:21.224046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7772410-5324-4979-9f64-977b0ce90c92 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1690 microversion: 2.1 time: 0.147235 Jun 22 17:06:21.224565 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 297/609] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:21 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:21.825653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9c29e271-99a6-40f6-ac92-5ade71955132 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:21.826343 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9c29e271-99a6-40f6-ac92-5ade71955132 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:21.832864 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c29e271-99a6-40f6-ac92-5ade71955132 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:21.833309 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c29e271-99a6-40f6-ac92-5ade71955132 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:21.834056 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c29e271-99a6-40f6-ac92-5ade71955132 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:21.834505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c29e271-99a6-40f6-ac92-5ade71955132 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:21.964425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9c29e271-99a6-40f6-ac92-5ade71955132 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:21.971797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9c29e271-99a6-40f6-ac92-5ade71955132 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1663 microversion: 2.1 time: 0.150431 Jun 22 17:06:21.972381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 313/610] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:21 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:22.240468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f1adcbc1-947b-475d-8742-0839198e8867 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:22.242314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f1adcbc1-947b-475d-8742-0839198e8867 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:22.247981 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1adcbc1-947b-475d-8742-0839198e8867 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:22.248467 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1adcbc1-947b-475d-8742-0839198e8867 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:22.249220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1adcbc1-947b-475d-8742-0839198e8867 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:22.249649 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1adcbc1-947b-475d-8742-0839198e8867 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:22.374082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f1adcbc1-947b-475d-8742-0839198e8867 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:22.381422 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f1adcbc1-947b-475d-8742-0839198e8867 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1690 microversion: 2.1 time: 0.144736 Jun 22 17:06:22.382007 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 298/611] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:22 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1690 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:22.989959 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6ac4c6f0-e559-40ee-ae81-cf7a21b2f6e0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:22.990492 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6ac4c6f0-e559-40ee-ae81-cf7a21b2f6e0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:22.993491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:22.998193 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6ac4c6f0-e559-40ee-ae81-cf7a21b2f6e0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:22.998640 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6ac4c6f0-e559-40ee-ae81-cf7a21b2f6e0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:22.999445 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6ac4c6f0-e559-40ee-ae81-cf7a21b2f6e0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:22.999879 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6ac4c6f0-e559-40ee-ae81-cf7a21b2f6e0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:23.127123 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6ac4c6f0-e559-40ee-ae81-cf7a21b2f6e0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:23.135064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6ac4c6f0-e559-40ee-ae81-cf7a21b2f6e0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1663 microversion: 2.1 time: 0.149059 Jun 22 17:06:23.135626 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 314/612] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:22 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:23.397865 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-feb17a18-c6ef-4f00-a4d2-a96f15087c40 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:23.398516 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-feb17a18-c6ef-4f00-a4d2-a96f15087c40 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:23.404881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-feb17a18-c6ef-4f00-a4d2-a96f15087c40 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:23.405340 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-feb17a18-c6ef-4f00-a4d2-a96f15087c40 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:23.406102 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-feb17a18-c6ef-4f00-a4d2-a96f15087c40 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:23.406536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-feb17a18-c6ef-4f00-a4d2-a96f15087c40 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:23.546292 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-feb17a18-c6ef-4f00-a4d2-a96f15087c40 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:23.553607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-feb17a18-c6ef-4f00-a4d2-a96f15087c40 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1690 microversion: 2.1 time: 0.159605 Jun 22 17:06:23.554159 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 299/613] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:23 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:24.151757 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1d0323dc-5779-4c5a-86b8-0851c6d4727a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:24.152407 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1d0323dc-5779-4c5a-86b8-0851c6d4727a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:24.159134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1d0323dc-5779-4c5a-86b8-0851c6d4727a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:24.159579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1d0323dc-5779-4c5a-86b8-0851c6d4727a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:24.160635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1d0323dc-5779-4c5a-86b8-0851c6d4727a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:24.161069 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1d0323dc-5779-4c5a-86b8-0851c6d4727a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:24.377001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1d0323dc-5779-4c5a-86b8-0851c6d4727a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:24.384441 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1d0323dc-5779-4c5a-86b8-0851c6d4727a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1663 microversion: 2.1 time: 0.237031 Jun 22 17:06:24.385024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 315/614] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:24 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1663 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:24.570860 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9bead726-0df9-48ff-b2ab-92ddb691ce96 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:24.571493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9bead726-0df9-48ff-b2ab-92ddb691ce96 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:24.577634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bead726-0df9-48ff-b2ab-92ddb691ce96 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:24.578082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bead726-0df9-48ff-b2ab-92ddb691ce96 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:24.578877 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bead726-0df9-48ff-b2ab-92ddb691ce96 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:24.579311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bead726-0df9-48ff-b2ab-92ddb691ce96 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:24.706826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bead726-0df9-48ff-b2ab-92ddb691ce96 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:24.714677 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9bead726-0df9-48ff-b2ab-92ddb691ce96 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1690 microversion: 2.1 time: 0.147825 Jun 22 17:06:24.715233 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 300/615] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:24 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:25.401469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-10366c28-96fa-4087-a546-9b9ae9b64250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:25.402083 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-10366c28-96fa-4087-a546-9b9ae9b64250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:25.408563 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-10366c28-96fa-4087-a546-9b9ae9b64250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:25.409009 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-10366c28-96fa-4087-a546-9b9ae9b64250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:25.409768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-10366c28-96fa-4087-a546-9b9ae9b64250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:25.410206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-10366c28-96fa-4087-a546-9b9ae9b64250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:25.592604 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-10366c28-96fa-4087-a546-9b9ae9b64250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:25.599908 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-10366c28-96fa-4087-a546-9b9ae9b64250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1663 microversion: 2.1 time: 0.202340 Jun 22 17:06:25.600510 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 316/616] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:25 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1663 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:25.732002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fb8f0eff-62cf-4588-9847-a8e8576bb0d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:25.732636 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fb8f0eff-62cf-4588-9847-a8e8576bb0d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:25.739259 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb8f0eff-62cf-4588-9847-a8e8576bb0d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:25.739723 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb8f0eff-62cf-4588-9847-a8e8576bb0d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:25.740555 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb8f0eff-62cf-4588-9847-a8e8576bb0d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:25.740980 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb8f0eff-62cf-4588-9847-a8e8576bb0d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:25.826058 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fb8f0eff-62cf-4588-9847-a8e8576bb0d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:25.834204 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fb8f0eff-62cf-4588-9847-a8e8576bb0d5 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1622 microversion: 2.1 time: 0.106025 Jun 22 17:06:25.843419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 301/617] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:25 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1622 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:25.960987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-e0522dbf-66a9-4941-b55c-4b9ddcddb9a7 req-11c2490c-82c0-4d4d-9cde-2d2bdd703c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64220c7-ae61-46ea-ad86-122aee7e0a1a", "name": "network-vif-deleted", "tag": "fcd6efe8-f80c-4c03-84a9-bd2560f1f166"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:06:25.973745 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-e0522dbf-66a9-4941-b55c-4b9ddcddb9a7 req-11c2490c-82c0-4d4d-9cde-2d2bdd703c41 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:25.974512 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-e0522dbf-66a9-4941-b55c-4b9ddcddb9a7 req-11c2490c-82c0-4d4d-9cde-2d2bdd703c41 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:25.986684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-e0522dbf-66a9-4941-b55c-4b9ddcddb9a7 req-11c2490c-82c0-4d4d-9cde-2d2bdd703c41 service nova] Creating event network-vif-deleted:fcd6efe8-f80c-4c03-84a9-bd2560f1f166 for instance b64220c7-ae61-46ea-ad86-122aee7e0a1a on hv-cinder-81045 Jun 22 17:06:25.991851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-e0522dbf-66a9-4941-b55c-4b9ddcddb9a7 req-11c2490c-82c0-4d4d-9cde-2d2bdd703c41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Jun 22 17:06:25.992477 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 317/618] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:06:26.617662 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-26125d7d-1d7a-435e-99c0-5e62ae000224 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:26.618312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-26125d7d-1d7a-435e-99c0-5e62ae000224 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:26.624217 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26125d7d-1d7a-435e-99c0-5e62ae000224 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:26.624665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26125d7d-1d7a-435e-99c0-5e62ae000224 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:26.625417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26125d7d-1d7a-435e-99c0-5e62ae000224 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:26.625844 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26125d7d-1d7a-435e-99c0-5e62ae000224 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:26.794626 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-26125d7d-1d7a-435e-99c0-5e62ae000224 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:26.802718 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-26125d7d-1d7a-435e-99c0-5e62ae000224 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1667 microversion: 2.1 time: 0.188965 Jun 22 17:06:26.803311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 302/619] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:26 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1667 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:26.852302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:26.853850 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:26.860484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:26.861227 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:26.861993 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:26.862418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:26.896522 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:26.897185 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:26.898133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lazy-loading 'fault' on Instance uuid b64220c7-ae61-46ea-ad86-122aee7e0a1a {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:06:26.948830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:26.959353 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-99de7fe5-348a-46cb-8134-3ebd89d4841e tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 200 len: 1336 microversion: 2.1 time: 0.111615 Jun 22 17:06:26.960321 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 318/620] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:26 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:27.976115 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:27.976747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: b64220c7-ae61-46ea-ad86-122aee7e0a1a] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:27.983349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:27.989263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:27.989263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:27.989263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:28.000250 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] HTTP exception thrown: Instance b64220c7-ae61-46ea-ad86-122aee7e0a1a could not be found. Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Request method failure captured: Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a HTTP/1.1 Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0pRX08G0hDAHdLZrPBdOY8xLt6MLOfbdxcPdnme58g8-lvFRI7YFKpc3vw_491ML24LRnxReqb6g0LlTuMBL3nYFv0dP7LJfMpJIU77xspWSTdgdRGywdQNuMO8vL9o2Jynur21dIF6ucwSjsG5goigxgPFKASXjuvCPLvgveP2-TY Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:06:28.001945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 276147f205ae43da9df678dcd572115a Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance b64220c7-ae61-46ea-ad86-122aee7e0a1a could not be found. Jun 22 17:06:28.003607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': 'b64220c7-ae61-46ea-ad86-122aee7e0a1a'} Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64220c7-ae61-46ea-ad86-122aee7e0a1a could not be found. Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:06:28.004651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64220c7-ae61-46ea-ad86-122aee7e0a1a could not be found. Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64220c7-ae61-46ea-ad86-122aee7e0a1a could not be found. Jun 22 17:06:28.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:06:28.012786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Returning 404 to user: Instance b64220c7-ae61-46ea-ad86-122aee7e0a1a could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:06:28.012786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-40115ddd-a4bc-437b-8384-a1dd703fb66f tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a" status: 404 len: 111 microversion: 2.1 time: 0.031122 Jun 22 17:06:28.012786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 303/621] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:27 2022] GET /compute/v2.1/servers/b64220c7-ae61-46ea-ad86-122aee7e0a1a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:06:28.013824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2cdd1607-2fc5-499a-920b-1798c613143d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '.version_select at 0x7fe0a0e5ec10>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:28.096200 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2cdd1607-2fc5-499a-920b-1798c613143d tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652442716" status: 202 len: 0 microversion: 2.1 time: 0.087098 Jun 22 17:06:28.096779 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 319/622] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 22 17:06:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652442716 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:06:31.626174 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3e990a20-2e91-47cf-a3fc-bdc6db6d3662 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:31.626672 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3e990a20-2e91-47cf-a3fc-bdc6db6d3662 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:31.633018 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e990a20-2e91-47cf-a3fc-bdc6db6d3662 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:31.633975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e990a20-2e91-47cf-a3fc-bdc6db6d3662 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:31.634729 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e990a20-2e91-47cf-a3fc-bdc6db6d3662 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:31.635160 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e990a20-2e91-47cf-a3fc-bdc6db6d3662 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:31.659791 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3e990a20-2e91-47cf-a3fc-bdc6db6d3662 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:06:31.946357 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3e990a20-2e91-47cf-a3fc-bdc6db6d3662 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 204 len: 0 microversion: 2.1 time: 0.322998 Jun 22 17:06:31.946944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 304/623] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:06:31 2022] DELETE /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:06:31.955630 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-361b2221-b21c-4430-bfdc-90ce8bacd244 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:31.956298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-361b2221-b21c-4430-bfdc-90ce8bacd244 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:31.962950 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-361b2221-b21c-4430-bfdc-90ce8bacd244 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:31.963396 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-361b2221-b21c-4430-bfdc-90ce8bacd244 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:31.964209 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-361b2221-b21c-4430-bfdc-90ce8bacd244 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:31.964639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-361b2221-b21c-4430-bfdc-90ce8bacd244 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:32.092267 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-361b2221-b21c-4430-bfdc-90ce8bacd244 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:32.099582 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-361b2221-b21c-4430-bfdc-90ce8bacd244 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1507 microversion: 2.1 time: 0.148466 Jun 22 17:06:32.100151 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 320/624] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:31 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:33.116864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e7477f5c-294c-40db-b923-8465c1589e9c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:33.117569 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e7477f5c-294c-40db-b923-8465c1589e9c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:33.124379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e7477f5c-294c-40db-b923-8465c1589e9c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:33.124833 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e7477f5c-294c-40db-b923-8465c1589e9c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:33.125601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e7477f5c-294c-40db-b923-8465c1589e9c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:33.126064 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e7477f5c-294c-40db-b923-8465c1589e9c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:33.255459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e7477f5c-294c-40db-b923-8465c1589e9c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:33.263375 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e7477f5c-294c-40db-b923-8465c1589e9c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1507 microversion: 2.1 time: 0.150723 Jun 22 17:06:33.264006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 305/625] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:33 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:33.580088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-d7a74bdd-c430-4fa2-b26a-f9c6b05c8796 req-bbb2056b-9321-4eba-a2e4-04d33282178f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dde809-575a-4930-b8f5-c7e39aee3f0b", "name": "network-vif-deleted", "tag": "de9e5802-9729-4b30-b197-c80475f34f49"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:06:33.587938 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-d7a74bdd-c430-4fa2-b26a-f9c6b05c8796 req-bbb2056b-9321-4eba-a2e4-04d33282178f service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:33.588409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-d7a74bdd-c430-4fa2-b26a-f9c6b05c8796 req-bbb2056b-9321-4eba-a2e4-04d33282178f service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:33.599094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-d7a74bdd-c430-4fa2-b26a-f9c6b05c8796 req-bbb2056b-9321-4eba-a2e4-04d33282178f service nova] Creating event network-vif-deleted:de9e5802-9729-4b30-b197-c80475f34f49 for instance 18dde809-575a-4930-b8f5-c7e39aee3f0b on hv-cinder-81045 Jun 22 17:06:33.604027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-d7a74bdd-c430-4fa2-b26a-f9c6b05c8796 req-bbb2056b-9321-4eba-a2e4-04d33282178f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027871 Jun 22 17:06:33.604648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 321/626] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:06:34.280749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:34.281370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:34.288186 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:34.288635 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:34.289423 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:34.290425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:34.322175 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:34.322619 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:34.323068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lazy-loading 'fault' on Instance uuid 18dde809-575a-4930-b8f5-c7e39aee3f0b {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:06:34.368066 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:34.375469 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-372b1666-8d06-4924-b60e-dffefdb4b00c tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 200 len: 1312 microversion: 2.1 time: 0.098588 Jun 22 17:06:34.376022 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 306/627] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:34 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:35.399468 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:35.400208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 18dde809-575a-4930-b8f5-c7e39aee3f0b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:35.406355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:35.406802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:35.407559 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:35.407989 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:35.421611 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] HTTP exception thrown: Instance 18dde809-575a-4930-b8f5-c7e39aee3f0b could not be found. Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Request method failure captured: Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b HTTP/1.1 Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pRX08G0hDAHdLZrPBdOY8xLt6MLOfbdxcPdnme58g8-lvFRI7YFKpc3vw_491ML24LRnxReqb6g0LlTuMBL3nYFv0dP7LJfMpJIU77xspWSTdgdRGywdQNuMO8vL9o2Jynur21dIF6ucwSjsG5goigxgPFKASXjuvCPLvgveP2-TY Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:06:35.423217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 276147f205ae43da9df678dcd572115a Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 18dde809-575a-4930-b8f5-c7e39aee3f0b could not be found. Jun 22 17:06:35.425029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '18dde809-575a-4930-b8f5-c7e39aee3f0b'} Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dde809-575a-4930-b8f5-c7e39aee3f0b could not be found. Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:06:35.426152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dde809-575a-4930-b8f5-c7e39aee3f0b could not be found. Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dde809-575a-4930-b8f5-c7e39aee3f0b could not be found. Jun 22 17:06:35.427854 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:35.429289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Returning 404 to user: Instance 18dde809-575a-4930-b8f5-c7e39aee3f0b could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:06:35.429289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ef6a328e-d90a-4d99-a248-6c0aad1c7843 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b" status: 404 len: 111 microversion: 2.1 time: 0.029925 Jun 22 17:06:35.429289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 322/628] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:35 2022] GET /compute/v2.1/servers/18dde809-575a-4930-b8f5-c7e39aee3f0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:06:35.434404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5421070c-c56f-423f-908b-3c1ba669f9dd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:35.434893 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5421070c-c56f-423f-908b-3c1ba669f9dd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:35.441218 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5421070c-c56f-423f-908b-3c1ba669f9dd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:35.441662 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5421070c-c56f-423f-908b-3c1ba669f9dd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:35.442405 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5421070c-c56f-423f-908b-3c1ba669f9dd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:35.442835 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5421070c-c56f-423f-908b-3c1ba669f9dd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:35.467074 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5421070c-c56f-423f-908b-3c1ba669f9dd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:06:35.763075 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5421070c-c56f-423f-908b-3c1ba669f9dd tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 204 len: 0 microversion: 2.1 time: 0.332746 Jun 22 17:06:35.763585 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 307/629] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:06:35 2022] DELETE /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:06:35.771437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-80ccdf3e-ece3-4679-88ac-4d02bd8c7839 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:35.777741 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-80ccdf3e-ece3-4679-88ac-4d02bd8c7839 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:35.778315 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80ccdf3e-ece3-4679-88ac-4d02bd8c7839 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:35.778761 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80ccdf3e-ece3-4679-88ac-4d02bd8c7839 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:35.779521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80ccdf3e-ece3-4679-88ac-4d02bd8c7839 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:35.780142 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80ccdf3e-ece3-4679-88ac-4d02bd8c7839 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:35.909633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-80ccdf3e-ece3-4679-88ac-4d02bd8c7839 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:35.917403 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-80ccdf3e-ece3-4679-88ac-4d02bd8c7839 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.149812 Jun 22 17:06:35.917948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 323/630] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:35 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:36.935335 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72819bed-0e4c-4ea5-b83c-399d78131b90 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:36.936027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-72819bed-0e4c-4ea5-b83c-399d78131b90 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:36.942393 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72819bed-0e4c-4ea5-b83c-399d78131b90 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:36.943100 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72819bed-0e4c-4ea5-b83c-399d78131b90 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:36.943871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72819bed-0e4c-4ea5-b83c-399d78131b90 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:36.944339 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72819bed-0e4c-4ea5-b83c-399d78131b90 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:36.963098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:37.075157 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-72819bed-0e4c-4ea5-b83c-399d78131b90 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:37.082379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-72819bed-0e4c-4ea5-b83c-399d78131b90 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1522 microversion: 2.1 time: 0.151221 Jun 22 17:06:37.082933 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 308/631] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:36 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:37.226022 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-3eb4f56c-1c26-4ff3-8971-640b84166a09 req-9ad96f9f-8f31-426e-b0ac-11d611fac878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72608569-4d23-4997-b09f-a8a50c5ba239", "name": "network-vif-deleted", "tag": "f95e3858-0316-45ba-bcbb-2f08067c76ff"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:06:37.235415 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-3eb4f56c-1c26-4ff3-8971-640b84166a09 req-9ad96f9f-8f31-426e-b0ac-11d611fac878 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:37.235851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-3eb4f56c-1c26-4ff3-8971-640b84166a09 req-9ad96f9f-8f31-426e-b0ac-11d611fac878 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:37.246269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-3eb4f56c-1c26-4ff3-8971-640b84166a09 req-9ad96f9f-8f31-426e-b0ac-11d611fac878 service nova] Creating event network-vif-deleted:f95e3858-0316-45ba-bcbb-2f08067c76ff for instance 72608569-4d23-4997-b09f-a8a50c5ba239 on hv-cinder-81045 Jun 22 17:06:37.251017 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-3eb4f56c-1c26-4ff3-8971-640b84166a09 req-9ad96f9f-8f31-426e-b0ac-11d611fac878 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028594 Jun 22 17:06:37.251663 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 324/632] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:06:38.099424 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:38.100062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:38.107265 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:38.107716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:38.108509 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:38.109077 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:38.140617 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:38.140984 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:38.141426 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lazy-loading 'fault' on Instance uuid 72608569-4d23-4997-b09f-a8a50c5ba239 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:06:38.181530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276147f205ae43da9df678dcd572115a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bd5d8cddc94945b967b114d49f086c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:38.188724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e4ba8466-11ed-4687-8c7d-c219bb9f9952 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 200 len: 1312 microversion: 2.1 time: 0.093386 Jun 22 17:06:38.189598 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 309/633] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:38 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:06:39.207260 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:39.207960 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] [instance: 72608569-4d23-4997-b09f-a8a50c5ba239] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:39.214769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:39.215219 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:39.215976 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:39.216445 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:39.229110 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] HTTP exception thrown: Instance 72608569-4d23-4997-b09f-a8a50c5ba239 could not be found. Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Request method failure captured: Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 HTTP/1.1 Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0pRX08G0hDAHdLZrPBdOY8xLt6MLOfbdxcPdnme58g8-lvFRI7YFKpc3vw_491ML24LRnxReqb6g0LlTuMBL3nYFv0dP7LJfMpJIU77xspWSTdgdRGywdQNuMO8vL9o2Jynur21dIF6ucwSjsG5goigxgPFKASXjuvCPLvgveP2-TY Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:06:39.230694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/47bd5d8cddc94945b967b114d49f086c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 47bd5d8cddc94945b967b114d49f086c Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359722790 Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 276147f205ae43da9df678dcd572115a Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359722790-project Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 72608569-4d23-4997-b09f-a8a50c5ba239 could not be found. Jun 22 17:06:39.232278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '72608569-4d23-4997-b09f-a8a50c5ba239'} Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72608569-4d23-4997-b09f-a8a50c5ba239 could not be found. Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:06:39.233169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72608569-4d23-4997-b09f-a8a50c5ba239 could not be found. Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72608569-4d23-4997-b09f-a8a50c5ba239 could not be found. Jun 22 17:06:39.234661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:06:39.236302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] Returning 404 to user: Instance 72608569-4d23-4997-b09f-a8a50c5ba239 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:06:39.236302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-89611024-c9f9-4750-9b44-1342e0ee7944 tempest-ServerRescueNegativeTestJSON-1359722790 tempest-ServerRescueNegativeTestJSON-1359722790-project] 10.222.0.18 "GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239" status: 404 len: 111 microversion: 2.1 time: 0.029469 Jun 22 17:06:39.236302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 325/634] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:06:39 2022] GET /compute/v2.1/servers/72608569-4d23-4997-b09f-a8a50c5ba239 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:06:49.687275 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:49.801413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-842876c8-8bb4-4561-92c3-a1e7bea834fc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'create', calling method: .version_select at 0x7fe0a05f7280>, body: {"keypair": {"name": "tempest-keypair-1279481326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxleR8O0ndFyfcD7F7yoEjIHVpPm3wyr4TTpMegHwcrCB3jnAeW7P8UaZTcMrAImEXGzPjD2i2l/JObzJaXroCJ34r1LCbudUMZbntgRtEs2rDozXKJw4kINpBlJQ6UTA=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:06:49.816000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-842876c8-8bb4-4561-92c3-a1e7bea834fc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Getting quotas for project 8d5f63bad73c4a89b604c29290e4143f. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:06:49.820415 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-842876c8-8bb4-4561-92c3-a1e7bea834fc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Getting quotas for user afd423384efd459babccf3ff34214973 and project 8d5f63bad73c4a89b604c29290e4143f. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:06:49.906982 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-842876c8-8bb4-4561-92c3-a1e7bea834fc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.225151 Jun 22 17:06:49.907685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 310/635] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Jun 22 17:06:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 17:06:52.256136 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-993023925", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3453d2d-2b7e-4051-9b69-5a0492d7260a"}], "security_groups": [{"name": "tempest-securitygroup--1368847374"}], "key_name": "tempest-keypair-1279481326", "user_data": "}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:06:52.265744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:52.266456 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:52.388727 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] validate_networks() for [('e3453d2d-2b7e-4051-9b69-5a0492d7260a', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:06:52.851212 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:06:52.851634 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:06:52.852096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:06:52.852937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:06:52.853353 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:06:52.862603 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:52.863267 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:52.864055 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:52.864519 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:52.887727 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Getting quotas for project 8d5f63bad73c4a89b604c29290e4143f. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:06:52.891804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Getting quotas for user afd423384efd459babccf3ff34214973 and project 8d5f63bad73c4a89b604c29290e4143f. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:06:52.904447 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:06:52.906852 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:06:53.040030 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-994f104e-6a1b-4e82-b88e-c27c666b7091 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.789045 Jun 22 17:06:53.041012 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 326/636] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Jun 22 17:06:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 17:06:53.052888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-06fe69b0-2391-43b7-b977-15e8d9371a1a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:53.054105 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-06fe69b0-2391-43b7-b977-15e8d9371a1a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:53.128226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-06fe69b0-2391-43b7-b977-15e8d9371a1a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:53.137363 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-06fe69b0-2391-43b7-b977-15e8d9371a1a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:53.138907 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-06fe69b0-2391-43b7-b977-15e8d9371a1a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:53.140045 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-06fe69b0-2391-43b7-b977-15e8d9371a1a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1281 microversion: 2.20 time: 0.092957 Jun 22 17:06:53.140623 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 311/637] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:06:53 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:06:54.158348 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:54.159041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:54.166455 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:54.166901 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:54.168195 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:54.168623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:54.230517 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:54.238580 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:54.240142 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:54.241308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e3c72ce9-fde2-458b-b6a3-48e16fd97e0c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1285 microversion: 2.20 time: 0.087144 Jun 22 17:06:54.241850 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 327/638] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:06:54 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:06:55.259208 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:55.259850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:55.266232 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:55.266685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:55.268223 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:55.268223 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:55.329638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:55.337500 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:55.339078 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:55.340707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-007d3522-b260-4305-baa7-482a1a6f2d33 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1341 microversion: 2.20 time: 0.085413 Jun 22 17:06:55.341253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 312/639] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:06:55 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:06:56.359309 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:56.359914 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:56.366383 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:56.366834 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:56.367599 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:56.368036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:56.843812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:56.852947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:56.855458 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:56.857196 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-112d46f9-5710-4208-afc1-0a235c8cfa88 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.501890 Jun 22 17:06:56.861039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 328/640] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:06:56 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:06:57.282122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-98f65998-1343-4a21-a67e-272d966f0295 req-592bae4d-6300-4660-bc8f-3a698842539a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78bb9410-a261-4625-ae42-6fe5e09a8d75", "tag": "a1e73d37-f445-4221-9965-5b010394558b"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:06:57.291511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-98f65998-1343-4a21-a67e-272d966f0295 req-592bae4d-6300-4660-bc8f-3a698842539a service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:57.292087 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-98f65998-1343-4a21-a67e-272d966f0295 req-592bae4d-6300-4660-bc8f-3a698842539a service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:57.306854 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-98f65998-1343-4a21-a67e-272d966f0295 req-592bae4d-6300-4660-bc8f-3a698842539a service nova] Creating event network-changed:a1e73d37-f445-4221-9965-5b010394558b for instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 on hv-cinder-81045 Jun 22 17:06:57.312017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-98f65998-1343-4a21-a67e-272d966f0295 req-592bae4d-6300-4660-bc8f-3a698842539a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035027 Jun 22 17:06:57.317025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 313/641] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:06:57.875261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:57.875895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:57.882513 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:57.882959 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:57.883770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:57.884316 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:58.109979 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:58.121279 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:58.122786 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:58.123880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6be72762-2715-4374-9765-ea9b4542fba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.253546 Jun 22 17:06:58.124488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 329/642] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:06:57 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:06:59.143345 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:06:59.144029 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:06:59.150125 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:59.150563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:59.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:06:59.151771 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:06:59.284938 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:59.293635 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:59.295277 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:06:59.296425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2e72ba01-82bc-4a44-b5db-948b0607a0cf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.157718 Jun 22 17:06:59.296982 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 314/643] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:06:59 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:07:00.314369 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:00.314970 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:00.321493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:00.321934 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:00.322690 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:00.323117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:00.449092 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:00.457444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:00.458919 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:00.459996 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f7789790-180c-4c9e-8100-35f21f2b98d9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.149515 Jun 22 17:07:00.460586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 330/644] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:07:00 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:07:01.477192 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:01.477783 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:01.484372 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:01.484823 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:01.485588 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:01.486029 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:01.612412 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:01.620149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:01.621631 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:01.622712 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bfaabd81-7d80-499c-ac8d-d1148ea320a0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.149536 Jun 22 17:07:01.623253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 315/645] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:07:01 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:07:01.733138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3f11f5c0-aacc-455d-b445-1cbdc0339335 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:01.733661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3f11f5c0-aacc-455d-b445-1cbdc0339335 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:01.739921 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3f11f5c0-aacc-455d-b445-1cbdc0339335 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:01.740393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3f11f5c0-aacc-455d-b445-1cbdc0339335 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:01.741140 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3f11f5c0-aacc-455d-b445-1cbdc0339335 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:01.741566 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3f11f5c0-aacc-455d-b445-1cbdc0339335 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:01.763612 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-3f11f5c0-aacc-455d-b445-1cbdc0339335 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lazy-loading 'flavor' on Instance uuid 66c2b04e-ad8d-4468-9f45-91ce07db3fbe {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:07:02.012522 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3f11f5c0-aacc-455d-b445-1cbdc0339335 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "POST /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe/action" status: 202 len: 0 microversion: 2.1 time: 0.283311 Jun 22 17:07:02.013914 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 331/646] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:07:01 2022] POST /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:07:02.022917 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3df4cd64-87d3-424b-b854-ce3032a462df tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:02.023606 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3df4cd64-87d3-424b-b854-ce3032a462df tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:02.029963 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3df4cd64-87d3-424b-b854-ce3032a462df tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:02.030409 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3df4cd64-87d3-424b-b854-ce3032a462df tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:02.031165 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3df4cd64-87d3-424b-b854-ce3032a462df tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:02.031591 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3df4cd64-87d3-424b-b854-ce3032a462df tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:02.169730 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3df4cd64-87d3-424b-b854-ce3032a462df tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:02.177274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3df4cd64-87d3-424b-b854-ce3032a462df tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.158498 Jun 22 17:07:02.177846 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 316/647] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:02 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:02.641035 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:02.641766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:02.647846 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:02.648342 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:02.649098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:02.649532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:02.785039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:02.795072 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:02.796597 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:02.801219 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e8ae66ab-dcfd-4d1a-947f-df1d4194707b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.160942 Jun 22 17:07:02.801219 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 332/648] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:07:02 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:07:03.195012 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0bb56318-5079-4e6f-bac3-f4410b1c64cb tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:03.195627 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0bb56318-5079-4e6f-bac3-f4410b1c64cb tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:03.198000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:03.207062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bb56318-5079-4e6f-bac3-f4410b1c64cb tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:03.207877 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bb56318-5079-4e6f-bac3-f4410b1c64cb tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:03.208687 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bb56318-5079-4e6f-bac3-f4410b1c64cb tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:03.213396 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bb56318-5079-4e6f-bac3-f4410b1c64cb tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:03.340419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0bb56318-5079-4e6f-bac3-f4410b1c64cb tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:03.348383 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0bb56318-5079-4e6f-bac3-f4410b1c64cb tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.157141 Jun 22 17:07:03.348944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 317/649] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:03 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:03.815291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:03.815998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:03.817968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:03.818721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:03.823550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:03.824026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:03.824821 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:03.825327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:03.960414 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:03.968352 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:03.969886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:03.970912 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c24c7141-962c-4f38-bc3d-8b0804c4e909 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.159570 Jun 22 17:07:03.971454 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 333/650] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:07:03 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:07:04.365510 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7f3a0242-bd13-4250-a41f-c5c60f00849a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:04.366289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7f3a0242-bd13-4250-a41f-c5c60f00849a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:04.372721 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7f3a0242-bd13-4250-a41f-c5c60f00849a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:04.373170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7f3a0242-bd13-4250-a41f-c5c60f00849a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:04.373950 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7f3a0242-bd13-4250-a41f-c5c60f00849a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:04.374383 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7f3a0242-bd13-4250-a41f-c5c60f00849a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:04.502886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-23df53a5-dc08-45bc-bea0-ede7ca4bacd0 req-e7e0a3e7-41d6-4253-820b-6e989e39dfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bb9410-a261-4625-ae42-6fe5e09a8d75", "name": "network-vif-plugged", "status": "completed", "tag": "a1e73d37-f445-4221-9965-5b010394558b"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:04.510984 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-23df53a5-dc08-45bc-bea0-ede7ca4bacd0 req-e7e0a3e7-41d6-4253-820b-6e989e39dfdd service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:04.511435 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-23df53a5-dc08-45bc-bea0-ede7ca4bacd0 req-e7e0a3e7-41d6-4253-820b-6e989e39dfdd service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:04.514748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7f3a0242-bd13-4250-a41f-c5c60f00849a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:04.522173 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7f3a0242-bd13-4250-a41f-c5c60f00849a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.160511 Jun 22 17:07:04.522734 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 318/651] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:04 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:07:04.523110 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-23df53a5-dc08-45bc-bea0-ede7ca4bacd0 req-e7e0a3e7-41d6-4253-820b-6e989e39dfdd service nova] Creating event network-vif-plugged:a1e73d37-f445-4221-9965-5b010394558b for instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 on hv-cinder-81045 Jun 22 17:07:04.529096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-23df53a5-dc08-45bc-bea0-ede7ca4bacd0 req-e7e0a3e7-41d6-4253-820b-6e989e39dfdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091871 Jun 22 17:07:04.529675 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 334/652] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:04.988663 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:04.989279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:04.995191 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:04.995638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:04.996463 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:04.997414 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:05.127090 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:05.135008 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:05.136456 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:05.138170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3324f33b-54ac-454d-aaee-1ead7be2cea8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.152824 Jun 22 17:07:05.138717 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 319/653] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:07:04 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:07:05.540504 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-139939c2-4f62-4ea5-9329-b4328afee5d6 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:05.541113 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-139939c2-4f62-4ea5-9329-b4328afee5d6 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:05.547768 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-139939c2-4f62-4ea5-9329-b4328afee5d6 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:05.548243 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-139939c2-4f62-4ea5-9329-b4328afee5d6 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:05.548997 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-139939c2-4f62-4ea5-9329-b4328afee5d6 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:05.549429 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-139939c2-4f62-4ea5-9329-b4328afee5d6 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:05.684170 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-139939c2-4f62-4ea5-9329-b4328afee5d6 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:05.691660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-139939c2-4f62-4ea5-9329-b4328afee5d6 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.156178 Jun 22 17:07:05.692270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 335/654] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:05 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:06.144249 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a4089672-e42d-40bd-a42f-b68c9bfd8650 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1843999012"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:06.144829 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a4089672-e42d-40bd-a42f-b68c9bfd8650 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:06.151288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4089672-e42d-40bd-a42f-b68c9bfd8650 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:06.151733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4089672-e42d-40bd-a42f-b68c9bfd8650 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:06.152531 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4089672-e42d-40bd-a42f-b68c9bfd8650 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:06.152959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4089672-e42d-40bd-a42f-b68c9bfd8650 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:06.156265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:06.156881 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:06.163078 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:06.163528 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:06.164329 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:06.164763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:06.279322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.network.security_group_api [None req-a4089672-e42d-40bd-a42f-b68c9bfd8650 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Removing security group d380a16d-f222-4741-8695-31bce161d6cc from port 3e7194d2-b6a9-470a-93b2-77d89d7aafdb Jun 22 17:07:06.294382 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:06.302150 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:06.303633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:06.304780 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-344664c9-95f6-4501-bea6-4d793479706e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1407 microversion: 2.20 time: 0.153054 Jun 22 17:07:06.305327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 336/655] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:07:06 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:07:06.709270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-68e401cc-cfb1-4d02-9ba1-ef3701bc5273 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:06.709889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-68e401cc-cfb1-4d02-9ba1-ef3701bc5273 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:06.712235 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a4089672-e42d-40bd-a42f-b68c9bfd8650 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "POST /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/action" status: 202 len: 0 microversion: 2.1 time: 0.571798 Jun 22 17:07:06.712833 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 320/656] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:07:06 2022] POST /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:07:06.726597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-ec24fdf5-53b0-4557-9ddd-5cb38366f644 req-2e072dd5-ab67-4ea4-9599-e8710fd4139f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d468f375-b7cd-4cec-9a77-513abc2daba8", "tag": "3e7194d2-b6a9-470a-93b2-77d89d7aafdb"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:06.739569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68e401cc-cfb1-4d02-9ba1-ef3701bc5273 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:06.742115 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68e401cc-cfb1-4d02-9ba1-ef3701bc5273 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:06.743171 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68e401cc-cfb1-4d02-9ba1-ef3701bc5273 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:06.749395 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-68e401cc-cfb1-4d02-9ba1-ef3701bc5273 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:06.751357 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ec24fdf5-53b0-4557-9ddd-5cb38366f644 req-2e072dd5-ab67-4ea4-9599-e8710fd4139f service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:06.753099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ec24fdf5-53b0-4557-9ddd-5cb38366f644 req-2e072dd5-ab67-4ea4-9599-e8710fd4139f service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:06.811236 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-ec24fdf5-53b0-4557-9ddd-5cb38366f644 req-2e072dd5-ab67-4ea4-9599-e8710fd4139f service nova] Creating event network-changed:3e7194d2-b6a9-470a-93b2-77d89d7aafdb for instance d468f375-b7cd-4cec-9a77-513abc2daba8 on hv-cinder-81045 Jun 22 17:07:06.831684 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-ec24fdf5-53b0-4557-9ddd-5cb38366f644 req-2e072dd5-ab67-4ea4-9599-e8710fd4139f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112744 Jun 22 17:07:06.833050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 321/657] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:07.071993 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-68e401cc-cfb1-4d02-9ba1-ef3701bc5273 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:07.079949 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-68e401cc-cfb1-4d02-9ba1-ef3701bc5273 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.374363 Jun 22 17:07:07.080892 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 337/658] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:06 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:07.324587 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:07.326086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:07.332959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:07.333409 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:07.334175 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:07.334605 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:07.585194 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:07.585194 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:07.586694 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:07.587929 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0c3bde1a-efc2-464d-85da-eb6e7be3ab11 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1600 microversion: 2.20 time: 0.268870 Jun 22 17:07:07.588530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 322/659] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:07:07 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1600 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:07:07.607295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8ab0009e-cbdc-42af-8b21-c9a7a97fe1ce tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:07.611848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8ab0009e-cbdc-42af-8b21-c9a7a97fe1ce tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:07.614295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ab0009e-cbdc-42af-8b21-c9a7a97fe1ce tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:07.614747 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ab0009e-cbdc-42af-8b21-c9a7a97fe1ce tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:07.615730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ab0009e-cbdc-42af-8b21-c9a7a97fe1ce tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:07.616525 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ab0009e-cbdc-42af-8b21-c9a7a97fe1ce tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:07.694472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8ab0009e-cbdc-42af-8b21-c9a7a97fe1ce tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092159 Jun 22 17:07:07.695120 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 338/660] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Jun 22 17:07:07 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 17:07:08.097513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d3556c52-3ee0-4782-871d-b4bbc9c52088 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:08.098435 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d3556c52-3ee0-4782-871d-b4bbc9c52088 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:08.105229 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3556c52-3ee0-4782-871d-b4bbc9c52088 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:08.105885 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3556c52-3ee0-4782-871d-b4bbc9c52088 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:08.107196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3556c52-3ee0-4782-871d-b4bbc9c52088 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:08.107632 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3556c52-3ee0-4782-871d-b4bbc9c52088 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:08.200353 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f8787222-ea01-4b5d-8eb7-8e34dfc759f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:08.201461 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f8787222-ea01-4b5d-8eb7-8e34dfc759f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:08.212613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f8787222-ea01-4b5d-8eb7-8e34dfc759f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:08.212613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f8787222-ea01-4b5d-8eb7-8e34dfc759f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:08.212613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f8787222-ea01-4b5d-8eb7-8e34dfc759f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:08.212613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f8787222-ea01-4b5d-8eb7-8e34dfc759f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:08.269013 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d3556c52-3ee0-4782-871d-b4bbc9c52088 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:08.279100 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d3556c52-3ee0-4782-871d-b4bbc9c52088 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.184314 Jun 22 17:07:08.281439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 323/661] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:08 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:08.305237 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-f8787222-ea01-4b5d-8eb7-8e34dfc759f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lazy-loading 'services' on Instance uuid d468f375-b7cd-4cec-9a77-513abc2daba8 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:07:08.552492 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f8787222-ea01-4b5d-8eb7-8e34dfc759f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments/a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef" status: 202 len: 0 microversion: 2.1 time: 0.356207 Jun 22 17:07:08.556542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 339/662] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:07:08 2022] DELETE /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments/a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 17:07:08.583323 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0175a99e-5ebb-4084-9407-25c054d58b77 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:08.584932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0175a99e-5ebb-4084-9407-25c054d58b77 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:08.597031 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0175a99e-5ebb-4084-9407-25c054d58b77 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:08.597486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0175a99e-5ebb-4084-9407-25c054d58b77 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:08.598373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0175a99e-5ebb-4084-9407-25c054d58b77 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:08.599330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0175a99e-5ebb-4084-9407-25c054d58b77 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:08.632565 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0175a99e-5ebb-4084-9407-25c054d58b77 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073673 Jun 22 17:07:08.638702 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 324/663] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:07:08 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:08.756023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-6b7e3cec-2d52-46c7-9928-7af76146294e req-14e51a72-3bb8-4295-b04a-723d47356840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78bb9410-a261-4625-ae42-6fe5e09a8d75", "tag": "a1e73d37-f445-4221-9965-5b010394558b"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:08.764948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-6b7e3cec-2d52-46c7-9928-7af76146294e req-14e51a72-3bb8-4295-b04a-723d47356840 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:08.765387 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-6b7e3cec-2d52-46c7-9928-7af76146294e req-14e51a72-3bb8-4295-b04a-723d47356840 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:08.777583 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-6b7e3cec-2d52-46c7-9928-7af76146294e req-14e51a72-3bb8-4295-b04a-723d47356840 service nova] Creating event network-changed:a1e73d37-f445-4221-9965-5b010394558b for instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 on hv-cinder-81045 Jun 22 17:07:08.783437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-6b7e3cec-2d52-46c7-9928-7af76146294e req-14e51a72-3bb8-4295-b04a-723d47356840 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031423 Jun 22 17:07:08.784362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 340/664] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:08.853102 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-48f53ada-d76f-49e7-b7d2-6dbdf6f16f79 req-eb32907c-d9d3-47ad-a595-c43d043e0377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d468f375-b7cd-4cec-9a77-513abc2daba8", "tag": "3e7194d2-b6a9-470a-93b2-77d89d7aafdb"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:08.862711 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-48f53ada-d76f-49e7-b7d2-6dbdf6f16f79 req-eb32907c-d9d3-47ad-a595-c43d043e0377 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:08.863468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-48f53ada-d76f-49e7-b7d2-6dbdf6f16f79 req-eb32907c-d9d3-47ad-a595-c43d043e0377 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:08.876914 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-48f53ada-d76f-49e7-b7d2-6dbdf6f16f79 req-eb32907c-d9d3-47ad-a595-c43d043e0377 service nova] Creating event network-changed:3e7194d2-b6a9-470a-93b2-77d89d7aafdb for instance d468f375-b7cd-4cec-9a77-513abc2daba8 on hv-cinder-81045 Jun 22 17:07:08.882529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-48f53ada-d76f-49e7-b7d2-6dbdf6f16f79 req-eb32907c-d9d3-47ad-a595-c43d043e0377 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032887 Jun 22 17:07:08.883241 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 325/665] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:09.300028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6fa38934-c0a8-4163-bfd2-62aa4cdb3d84 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:09.300933 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6fa38934-c0a8-4163-bfd2-62aa4cdb3d84 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:09.307706 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6fa38934-c0a8-4163-bfd2-62aa4cdb3d84 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:09.308184 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6fa38934-c0a8-4163-bfd2-62aa4cdb3d84 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:09.308963 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6fa38934-c0a8-4163-bfd2-62aa4cdb3d84 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:09.309431 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6fa38934-c0a8-4163-bfd2-62aa4cdb3d84 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:09.552328 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6fa38934-c0a8-4163-bfd2-62aa4cdb3d84 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:09.562067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6fa38934-c0a8-4163-bfd2-62aa4cdb3d84 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.267044 Jun 22 17:07:09.562847 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 341/666] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:09 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:09.645334 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7b09dde8-53e1-4230-9f28-b1b1073d2fe0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:09.646432 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7b09dde8-53e1-4230-9f28-b1b1073d2fe0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:09.654179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b09dde8-53e1-4230-9f28-b1b1073d2fe0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:09.654979 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b09dde8-53e1-4230-9f28-b1b1073d2fe0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:09.655921 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b09dde8-53e1-4230-9f28-b1b1073d2fe0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:09.656545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b09dde8-53e1-4230-9f28-b1b1073d2fe0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:09.688864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7b09dde8-53e1-4230-9f28-b1b1073d2fe0 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047735 Jun 22 17:07:09.689895 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 326/667] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:07:09 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:10.579286 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-74efbad3-af4d-43f8-8ffd-8363361f2ac3 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:10.579878 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-74efbad3-af4d-43f8-8ffd-8363361f2ac3 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:10.586386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-74efbad3-af4d-43f8-8ffd-8363361f2ac3 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:10.586827 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-74efbad3-af4d-43f8-8ffd-8363361f2ac3 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:10.587578 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-74efbad3-af4d-43f8-8ffd-8363361f2ac3 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:10.588006 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-74efbad3-af4d-43f8-8ffd-8363361f2ac3 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:10.591999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:10.700597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1934b157-1f39-47af-ad46-a1d9fbb47d15 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:10.701678 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1934b157-1f39-47af-ad46-a1d9fbb47d15 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:10.707916 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1934b157-1f39-47af-ad46-a1d9fbb47d15 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:10.708400 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1934b157-1f39-47af-ad46-a1d9fbb47d15 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:10.709161 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1934b157-1f39-47af-ad46-a1d9fbb47d15 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:10.709593 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1934b157-1f39-47af-ad46-a1d9fbb47d15 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:10.720374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-74efbad3-af4d-43f8-8ffd-8363361f2ac3 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:10.727870 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-74efbad3-af4d-43f8-8ffd-8363361f2ac3 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.152404 Jun 22 17:07:10.728561 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 342/668] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:10 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:10.738665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1934b157-1f39-47af-ad46-a1d9fbb47d15 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041906 Jun 22 17:07:10.739179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 327/669] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:07:10 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 17:07:10.754873 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:10.755343 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:10.761345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:10.761791 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:10.762578 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:10.763010 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:10.836582 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] HTTP exception thrown: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 is not attached to volume a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Request method failure captured: Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: DELETE /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments/a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef HTTP/1.1 Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0s7StYDVEONyb_12fMsxaR8Q0Kc7ntg_C0BoWlelxEX7dyO4_TvAzFQ3PfWPFSfrs37HAT8sJ9yVybw2kzD2XEeUrP0WDWwTevlR7N3_iAO4EF15TpViWLOLsJzPNTWKilQWoz5PkRkAvA7fxvrf62h7pS7-j0gZye86dqLPj3tWSs Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: fb2f9e80471c4d6b93febc9534cb9be6 Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-TestMinimumBasicScenario-1421276506 Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:07:10.838898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2f9e80471c4d6b93febc9534cb9be6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb2f9e80471c4d6b93febc9534cb9be6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2f9e80471c4d6b93febc9534cb9be6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb2f9e80471c4d6b93febc9534cb9be6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-TestMinimumBasicScenario-1421276506 Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: fb2f9e80471c4d6b93febc9534cb9be6 Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1421276506 Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-TestMinimumBasicScenario-1421276506-project Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 9719a17bb03b43a09dcd7bf4f019c81c Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-TestMinimumBasicScenario-1421276506-project Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:07:10.840618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 is not attached to volume a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'server_id': 'd468f375-b7cd-4cec-9a77-513abc2daba8', 'id': 'a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef'} Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef. Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:07:10.841539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 is not attached to volume a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 is not attached to volume a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:10.843052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Returning 404 to user: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 is not attached to volume a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:07:10.844215 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bd10b176-0597-4ba3-ac1d-094d989efc43 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments/a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef" status: 404 len: 154 microversion: 2.1 time: 0.089366 Jun 22 17:07:10.844215 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 343/670] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:07:10 2022] DELETE /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8/os-volume_attachments/a3dc177a-5ab8-4332-8e36-23d4d4c7b4ef => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:07:11.744928 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-402b2155-3401-42f0-bcc6-fd7d6e35f288 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:11.745535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-402b2155-3401-42f0-bcc6-fd7d6e35f288 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:11.751962 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-402b2155-3401-42f0-bcc6-fd7d6e35f288 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:11.752438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-402b2155-3401-42f0-bcc6-fd7d6e35f288 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:11.753191 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-402b2155-3401-42f0-bcc6-fd7d6e35f288 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:11.753622 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-402b2155-3401-42f0-bcc6-fd7d6e35f288 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:11.880593 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-402b2155-3401-42f0-bcc6-fd7d6e35f288 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:11.888525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-402b2155-3401-42f0-bcc6-fd7d6e35f288 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.147473 Jun 22 17:07:11.889074 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 328/671] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:11 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:12.106948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9087e4ea-9b2d-4a85-8879-4091b01dea54 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:12.107442 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9087e4ea-9b2d-4a85-8879-4091b01dea54 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:12.113891 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9087e4ea-9b2d-4a85-8879-4091b01dea54 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:12.114337 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9087e4ea-9b2d-4a85-8879-4091b01dea54 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:12.115091 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9087e4ea-9b2d-4a85-8879-4091b01dea54 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:12.115520 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9087e4ea-9b2d-4a85-8879-4091b01dea54 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:12.140838 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9087e4ea-9b2d-4a85-8879-4091b01dea54 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:07:12.408049 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9087e4ea-9b2d-4a85-8879-4091b01dea54 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 204 len: 0 microversion: 2.1 time: 0.304567 Jun 22 17:07:12.408577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 344/672] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:07:12 2022] DELETE /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:07:12.416935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fb161edf-ee5d-496b-844f-9e07f5a708ae tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:12.417540 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fb161edf-ee5d-496b-844f-9e07f5a708ae tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:12.423881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb161edf-ee5d-496b-844f-9e07f5a708ae tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:12.428504 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb161edf-ee5d-496b-844f-9e07f5a708ae tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:12.428504 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb161edf-ee5d-496b-844f-9e07f5a708ae tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:12.428504 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb161edf-ee5d-496b-844f-9e07f5a708ae tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:12.429439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:12.555450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fb161edf-ee5d-496b-844f-9e07f5a708ae tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:12.563514 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fb161edf-ee5d-496b-844f-9e07f5a708ae tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1552 microversion: 2.1 time: 0.150384 Jun 22 17:07:12.564073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 329/673] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:12 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:12.906405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9961a8df-c2be-4fc6-abe8-9e1656649002 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:12.907121 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9961a8df-c2be-4fc6-abe8-9e1656649002 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:12.913409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9961a8df-c2be-4fc6-abe8-9e1656649002 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:12.913853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9961a8df-c2be-4fc6-abe8-9e1656649002 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:12.914608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9961a8df-c2be-4fc6-abe8-9e1656649002 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:12.915037 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9961a8df-c2be-4fc6-abe8-9e1656649002 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:13.048625 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9961a8df-c2be-4fc6-abe8-9e1656649002 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:13.056033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9961a8df-c2be-4fc6-abe8-9e1656649002 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.154347 Jun 22 17:07:13.056615 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 345/674] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:12 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:13.581030 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-39eb493d-8145-402f-9d54-bf968f5228f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:13.581616 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-39eb493d-8145-402f-9d54-bf968f5228f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:13.588265 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-39eb493d-8145-402f-9d54-bf968f5228f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:13.588710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-39eb493d-8145-402f-9d54-bf968f5228f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:13.589459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-39eb493d-8145-402f-9d54-bf968f5228f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:13.589886 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-39eb493d-8145-402f-9d54-bf968f5228f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:13.713402 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-39eb493d-8145-402f-9d54-bf968f5228f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:13.720684 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-39eb493d-8145-402f-9d54-bf968f5228f5 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1552 microversion: 2.1 time: 0.143405 Jun 22 17:07:13.721239 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 330/675] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:13 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1552 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:14.073014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d68fb618-0c2e-436c-8be8-0989a0e27b6b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:14.073628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d68fb618-0c2e-436c-8be8-0989a0e27b6b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:14.080811 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d68fb618-0c2e-436c-8be8-0989a0e27b6b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:14.081259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d68fb618-0c2e-436c-8be8-0989a0e27b6b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:14.082015 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d68fb618-0c2e-436c-8be8-0989a0e27b6b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:14.082448 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d68fb618-0c2e-436c-8be8-0989a0e27b6b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:14.212608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d68fb618-0c2e-436c-8be8-0989a0e27b6b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:14.220030 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d68fb618-0c2e-436c-8be8-0989a0e27b6b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.150848 Jun 22 17:07:14.220617 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 346/676] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:14 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:14.738074 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-25a2ed0f-d293-4185-9841-524c287f0def tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:14.738685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-25a2ed0f-d293-4185-9841-524c287f0def tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:14.745127 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25a2ed0f-d293-4185-9841-524c287f0def tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:14.745518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25a2ed0f-d293-4185-9841-524c287f0def tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:14.746315 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25a2ed0f-d293-4185-9841-524c287f0def tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:14.746707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25a2ed0f-d293-4185-9841-524c287f0def tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:14.875895 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-25a2ed0f-d293-4185-9841-524c287f0def tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:14.885414 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-25a2ed0f-d293-4185-9841-524c287f0def tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1552 microversion: 2.1 time: 0.151144 Jun 22 17:07:14.886134 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 331/677] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:14 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:15.237726 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1c029742-1f09-4dd0-85a7-54f7d8b9a36d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:15.238340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1c029742-1f09-4dd0-85a7-54f7d8b9a36d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:15.244876 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1c029742-1f09-4dd0-85a7-54f7d8b9a36d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:15.245320 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1c029742-1f09-4dd0-85a7-54f7d8b9a36d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:15.246082 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1c029742-1f09-4dd0-85a7-54f7d8b9a36d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:15.246515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1c029742-1f09-4dd0-85a7-54f7d8b9a36d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:15.459901 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1c029742-1f09-4dd0-85a7-54f7d8b9a36d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:15.467408 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1c029742-1f09-4dd0-85a7-54f7d8b9a36d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.233908 Jun 22 17:07:15.468053 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 347/678] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:15 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:15.687985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-57d62eb4-e236-4eb1-8515-34bc599b11df req-6143ca79-592f-45fa-882a-4ff8a6168105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d468f375-b7cd-4cec-9a77-513abc2daba8", "name": "network-vif-deleted", "tag": "3e7194d2-b6a9-470a-93b2-77d89d7aafdb"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:15.695918 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-57d62eb4-e236-4eb1-8515-34bc599b11df req-6143ca79-592f-45fa-882a-4ff8a6168105 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:15.696387 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-57d62eb4-e236-4eb1-8515-34bc599b11df req-6143ca79-592f-45fa-882a-4ff8a6168105 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:15.707353 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-57d62eb4-e236-4eb1-8515-34bc599b11df req-6143ca79-592f-45fa-882a-4ff8a6168105 service nova] Creating event network-vif-deleted:3e7194d2-b6a9-470a-93b2-77d89d7aafdb for instance d468f375-b7cd-4cec-9a77-513abc2daba8 on hv-cinder-81045 Jun 22 17:07:15.712288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-57d62eb4-e236-4eb1-8515-34bc599b11df req-6143ca79-592f-45fa-882a-4ff8a6168105 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028845 Jun 22 17:07:15.712964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 332/679] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:15.902895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-dabe189c-b097-4e98-a3b0-076010a650da tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:15.903526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-dabe189c-b097-4e98-a3b0-076010a650da tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:15.909532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dabe189c-b097-4e98-a3b0-076010a650da tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:15.912386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dabe189c-b097-4e98-a3b0-076010a650da tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:15.912386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dabe189c-b097-4e98-a3b0-076010a650da tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:15.912386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dabe189c-b097-4e98-a3b0-076010a650da tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:15.973437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-dabe189c-b097-4e98-a3b0-076010a650da tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9719a17bb03b43a09dcd7bf4f019c81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f9e80471c4d6b93febc9534cb9be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:15.981638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-dabe189c-b097-4e98-a3b0-076010a650da tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 200 len: 1341 microversion: 2.1 time: 0.082148 Jun 22 17:07:15.982213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 348/680] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:15 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 1341 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:16.485642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-803e8302-9a94-4095-9b1d-80ebf0b7b016 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:16.486340 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-803e8302-9a94-4095-9b1d-80ebf0b7b016 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:16.492914 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-803e8302-9a94-4095-9b1d-80ebf0b7b016 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:16.493363 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-803e8302-9a94-4095-9b1d-80ebf0b7b016 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:16.494120 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-803e8302-9a94-4095-9b1d-80ebf0b7b016 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:16.494552 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-803e8302-9a94-4095-9b1d-80ebf0b7b016 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:16.629398 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-803e8302-9a94-4095-9b1d-80ebf0b7b016 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:16.636851 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-803e8302-9a94-4095-9b1d-80ebf0b7b016 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.156059 Jun 22 17:07:16.637343 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 333/681] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:16 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:16.999040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:16.999645 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] [instance: d468f375-b7cd-4cec-9a77-513abc2daba8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:17.005876 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:17.006321 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:17.007155 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:17.007641 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:17.021935 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] HTTP exception thrown: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 could not be found. Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Request method failure captured: Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 HTTP/1.1 Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0s7StYDVEONyb_12fMsxaR8Q0Kc7ntg_C0BoWlelxEX7dyO4_TvAzFQ3PfWPFSfrs37HAT8sJ9yVybw2kzD2XEeUrP0WDWwTevlR7N3_iAO4EF15TpViWLOLsJzPNTWKilQWoz5PkRkAvA7fxvrf62h7pS7-j0gZye86dqLPj3tWSs Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: fb2f9e80471c4d6b93febc9534cb9be6 Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-TestMinimumBasicScenario-1421276506 Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:07:17.023575 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2f9e80471c4d6b93febc9534cb9be6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb2f9e80471c4d6b93febc9534cb9be6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb2f9e80471c4d6b93febc9534cb9be6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb2f9e80471c4d6b93febc9534cb9be6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-TestMinimumBasicScenario-1421276506 Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: fb2f9e80471c4d6b93febc9534cb9be6 Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1421276506 Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-TestMinimumBasicScenario-1421276506-project Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 9719a17bb03b43a09dcd7bf4f019c81c Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-TestMinimumBasicScenario-1421276506-project Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 could not be found. Jun 22 17:07:17.025062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': 'd468f375-b7cd-4cec-9a77-513abc2daba8'} Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 could not be found. Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:07:17.025849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 could not be found. Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 could not be found. Jun 22 17:07:17.027577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:07:17.029573 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Returning 404 to user: Instance d468f375-b7cd-4cec-9a77-513abc2daba8 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:07:17.029573 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-78a5827d-8b99-455e-b906-45efaabafc80 tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8" status: 404 len: 111 microversion: 2.1 time: 0.030270 Jun 22 17:07:17.029573 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 349/682] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:16 2022] GET /compute/v2.1/servers/d468f375-b7cd-4cec-9a77-513abc2daba8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:07:17.034073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-85c71994-4499-4783-9379-7c442dee150e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] Calling method '.version_select at 0x7fe0a04480d0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:17.112095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-85c71994-4499-4783-9379-7c442dee150e tempest-TestMinimumBasicScenario-1421276506 tempest-TestMinimumBasicScenario-1421276506-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-31462629" status: 202 len: 0 microversion: 2.1 time: 0.081716 Jun 22 17:07:17.112705 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 334/683] 10.222.0.18 () {58 vars in 1265 bytes} [Wed Jun 22 17:07:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-31462629 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:07:17.654106 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-99b89867-588b-4062-8af3-ef1e558d343d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:17.657359 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-99b89867-588b-4062-8af3-ef1e558d343d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:17.660958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99b89867-588b-4062-8af3-ef1e558d343d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:17.661659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99b89867-588b-4062-8af3-ef1e558d343d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:17.662407 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99b89867-588b-4062-8af3-ef1e558d343d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:17.662880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99b89867-588b-4062-8af3-ef1e558d343d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:17.863345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-99b89867-588b-4062-8af3-ef1e558d343d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:17.877029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-99b89867-588b-4062-8af3-ef1e558d343d tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.226750 Jun 22 17:07:17.877615 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 350/684] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:17 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:18.895233 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e689452d-c942-498e-9f27-1c53fb9ac2ad tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:18.895850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e689452d-c942-498e-9f27-1c53fb9ac2ad tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:18.901807 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e689452d-c942-498e-9f27-1c53fb9ac2ad tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:18.902248 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e689452d-c942-498e-9f27-1c53fb9ac2ad tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:18.903010 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e689452d-c942-498e-9f27-1c53fb9ac2ad tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:18.903443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e689452d-c942-498e-9f27-1c53fb9ac2ad tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:19.035048 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e689452d-c942-498e-9f27-1c53fb9ac2ad tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:19.043020 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e689452d-c942-498e-9f27-1c53fb9ac2ad tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.152223 Jun 22 17:07:19.043778 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 335/685] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:18 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:20.060568 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e2eaba4a-9058-492e-bc45-a01e97d62b3a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:20.061268 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e2eaba4a-9058-492e-bc45-a01e97d62b3a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:20.067885 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e2eaba4a-9058-492e-bc45-a01e97d62b3a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:20.068370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e2eaba4a-9058-492e-bc45-a01e97d62b3a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:20.069124 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e2eaba4a-9058-492e-bc45-a01e97d62b3a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:20.069554 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e2eaba4a-9058-492e-bc45-a01e97d62b3a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:20.230208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e2eaba4a-9058-492e-bc45-a01e97d62b3a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:20.239987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e2eaba4a-9058-492e-bc45-a01e97d62b3a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.183410 Jun 22 17:07:20.240921 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 351/686] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:20 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:20.363238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:07:20.365089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:07:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:07:21.256933 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-88614616-8dcd-41ff-8457-336dbcb280d0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:21.257729 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-88614616-8dcd-41ff-8457-336dbcb280d0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:21.260142 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:21.275919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-88614616-8dcd-41ff-8457-336dbcb280d0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:21.276396 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-88614616-8dcd-41ff-8457-336dbcb280d0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:21.277178 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-88614616-8dcd-41ff-8457-336dbcb280d0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:21.277610 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-88614616-8dcd-41ff-8457-336dbcb280d0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:21.495184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-88614616-8dcd-41ff-8457-336dbcb280d0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:21.503519 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-88614616-8dcd-41ff-8457-336dbcb280d0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1509 microversion: 2.1 time: 0.250440 Jun 22 17:07:21.515539 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 336/687] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:21 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1509 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:21.520764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ea770a81-1add-4e91-9ae5-a2bb0d0334f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:21.521335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ea770a81-1add-4e91-9ae5-a2bb0d0334f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:21.528420 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ea770a81-1add-4e91-9ae5-a2bb0d0334f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:21.529418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ea770a81-1add-4e91-9ae5-a2bb0d0334f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:21.541303 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ea770a81-1add-4e91-9ae5-a2bb0d0334f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:21.541303 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ea770a81-1add-4e91-9ae5-a2bb0d0334f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:21.815684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ea770a81-1add-4e91-9ae5-a2bb0d0334f0 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "POST /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe/action" status: 202 len: 0 microversion: 2.1 time: 0.298682 Jun 22 17:07:21.816413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 352/688] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 17:07:21 2022] POST /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:07:21.825019 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-60c120fe-96e0-424b-9b73-9d5b1c1360f9 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:21.829984 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-60c120fe-96e0-424b-9b73-9d5b1c1360f9 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:21.834176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-60c120fe-96e0-424b-9b73-9d5b1c1360f9 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:21.834857 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-60c120fe-96e0-424b-9b73-9d5b1c1360f9 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:21.835834 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-60c120fe-96e0-424b-9b73-9d5b1c1360f9 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:21.836487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-60c120fe-96e0-424b-9b73-9d5b1c1360f9 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:22.054821 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-60c120fe-96e0-424b-9b73-9d5b1c1360f9 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:22.070655 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-60c120fe-96e0-424b-9b73-9d5b1c1360f9 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1517 microversion: 2.1 time: 0.249785 Jun 22 17:07:22.080907 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 337/689] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:21 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:23.090119 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-efb0e465-be1e-4fd1-9702-e4fcb7e89111 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:23.090743 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-efb0e465-be1e-4fd1-9702-e4fcb7e89111 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:23.093444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:23.098422 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-efb0e465-be1e-4fd1-9702-e4fcb7e89111 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:23.098879 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-efb0e465-be1e-4fd1-9702-e4fcb7e89111 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:23.099657 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-efb0e465-be1e-4fd1-9702-e4fcb7e89111 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:23.100087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-efb0e465-be1e-4fd1-9702-e4fcb7e89111 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:23.497211 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-efb0e465-be1e-4fd1-9702-e4fcb7e89111 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:23.504798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-efb0e465-be1e-4fd1-9702-e4fcb7e89111 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1519 microversion: 2.1 time: 0.420030 Jun 22 17:07:23.505365 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 353/690] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:23 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1519 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:07:24.304993 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-276275a5-172c-4885-9321-d902b34680c0 req-62b69e91-04b7-4f7c-9085-d3b5d660e11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2b04e-ad8d-4468-9f45-91ce07db3fbe", "name": "network-vif-unplugged", "status": "completed", "tag": "d4c66ab3-2ffd-425f-9e48-6a35b15335cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:24.313990 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-276275a5-172c-4885-9321-d902b34680c0 req-62b69e91-04b7-4f7c-9085-d3b5d660e11d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:24.314437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-276275a5-172c-4885-9321-d902b34680c0 req-62b69e91-04b7-4f7c-9085-d3b5d660e11d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:24.334566 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.compute.server_external_events [req-276275a5-172c-4885-9321-d902b34680c0 req-62b69e91-04b7-4f7c-9085-d3b5d660e11d service nova] Unable to find a host for instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe. Dropping event network-vif-unplugged {{(pid=118472) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 17:07:24.335762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-276275a5-172c-4885-9321-d902b34680c0 req-62b69e91-04b7-4f7c-9085-d3b5d660e11d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034770 Jun 22 17:07:24.336948 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 338/691] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 17:07:24.522613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0fdeb8ae-39f8-40b4-9aa3-b6e1f526e56f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:24.523224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0fdeb8ae-39f8-40b4-9aa3-b6e1f526e56f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:24.530879 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0fdeb8ae-39f8-40b4-9aa3-b6e1f526e56f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:24.534338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0fdeb8ae-39f8-40b4-9aa3-b6e1f526e56f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:24.534338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0fdeb8ae-39f8-40b4-9aa3-b6e1f526e56f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:24.534338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0fdeb8ae-39f8-40b4-9aa3-b6e1f526e56f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:24.786116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0fdeb8ae-39f8-40b4-9aa3-b6e1f526e56f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:24.794206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0fdeb8ae-39f8-40b4-9aa3-b6e1f526e56f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1519 microversion: 2.1 time: 0.275403 Jun 22 17:07:24.794800 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 354/692] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:24 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:25.816251 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2ac8f035-9507-41f6-b2be-c6db08a54456 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:25.816863 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2ac8f035-9507-41f6-b2be-c6db08a54456 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:25.830944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ac8f035-9507-41f6-b2be-c6db08a54456 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:25.831428 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ac8f035-9507-41f6-b2be-c6db08a54456 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:25.832442 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ac8f035-9507-41f6-b2be-c6db08a54456 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:25.832880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ac8f035-9507-41f6-b2be-c6db08a54456 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:25.982191 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2ac8f035-9507-41f6-b2be-c6db08a54456 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:25.990072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2ac8f035-9507-41f6-b2be-c6db08a54456 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.181098 Jun 22 17:07:25.990651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 339/693] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:25 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:27.006468 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-265aa84b-897c-44bb-9725-1d5e2fc1c827 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:27.007302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-265aa84b-897c-44bb-9725-1d5e2fc1c827 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:27.014874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-265aa84b-897c-44bb-9725-1d5e2fc1c827 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:27.015328 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-265aa84b-897c-44bb-9725-1d5e2fc1c827 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:27.016098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-265aa84b-897c-44bb-9725-1d5e2fc1c827 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:27.016550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-265aa84b-897c-44bb-9725-1d5e2fc1c827 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:27.147086 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-265aa84b-897c-44bb-9725-1d5e2fc1c827 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:27.155051 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-265aa84b-897c-44bb-9725-1d5e2fc1c827 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.152430 Jun 22 17:07:27.155624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 355/694] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:27 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:28.172588 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-820787a3-d039-4fde-821e-b6529b8ab62f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:28.173128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-820787a3-d039-4fde-821e-b6529b8ab62f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:28.179505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-820787a3-d039-4fde-821e-b6529b8ab62f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:28.179944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-820787a3-d039-4fde-821e-b6529b8ab62f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:28.180736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-820787a3-d039-4fde-821e-b6529b8ab62f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:28.181163 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-820787a3-d039-4fde-821e-b6529b8ab62f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:28.309468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-820787a3-d039-4fde-821e-b6529b8ab62f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:28.317428 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-820787a3-d039-4fde-821e-b6529b8ab62f tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.149323 Jun 22 17:07:28.317973 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 340/695] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:28 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:29.334506 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7c6f11dc-4805-45f8-97fc-148b72dba3b1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:29.335040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7c6f11dc-4805-45f8-97fc-148b72dba3b1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:29.341484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c6f11dc-4805-45f8-97fc-148b72dba3b1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:29.341941 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c6f11dc-4805-45f8-97fc-148b72dba3b1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:29.342693 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c6f11dc-4805-45f8-97fc-148b72dba3b1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:29.343119 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c6f11dc-4805-45f8-97fc-148b72dba3b1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:29.469367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7c6f11dc-4805-45f8-97fc-148b72dba3b1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:29.472767 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:29.477179 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7c6f11dc-4805-45f8-97fc-148b72dba3b1 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.146603 Jun 22 17:07:29.477763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 356/696] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:29 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:30.058516 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-96cb8429-2707-4f68-8991-7951fd496152 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:30.059437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-96cb8429-2707-4f68-8991-7951fd496152 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:30.066420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96cb8429-2707-4f68-8991-7951fd496152 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:30.066867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96cb8429-2707-4f68-8991-7951fd496152 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:30.068396 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96cb8429-2707-4f68-8991-7951fd496152 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:30.069008 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96cb8429-2707-4f68-8991-7951fd496152 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:30.097460 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-96cb8429-2707-4f68-8991-7951fd496152 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042787 Jun 22 17:07:30.097998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 341/697] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:07:30 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 17:07:30.155805 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ab2a5952-a2df-43a8-94e5-d1949bab8ec0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:30.156337 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ab2a5952-a2df-43a8-94e5-d1949bab8ec0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:30.162853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ab2a5952-a2df-43a8-94e5-d1949bab8ec0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:30.163305 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ab2a5952-a2df-43a8-94e5-d1949bab8ec0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:30.164067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ab2a5952-a2df-43a8-94e5-d1949bab8ec0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:30.164530 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ab2a5952-a2df-43a8-94e5-d1949bab8ec0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:30.188047 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ab2a5952-a2df-43a8-94e5-d1949bab8ec0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:07:30.429680 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ab2a5952-a2df-43a8-94e5-d1949bab8ec0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 204 len: 0 microversion: 2.1 time: 0.278408 Jun 22 17:07:30.430368 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 357/698] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:07:30 2022] DELETE /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:07:30.439539 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4baa780d-65b5-419b-a28c-c7de91a884b1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:30.440171 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4baa780d-65b5-419b-a28c-c7de91a884b1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:30.447241 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4baa780d-65b5-419b-a28c-c7de91a884b1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:30.447682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4baa780d-65b5-419b-a28c-c7de91a884b1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:30.448461 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4baa780d-65b5-419b-a28c-c7de91a884b1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:30.448893 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4baa780d-65b5-419b-a28c-c7de91a884b1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:30.494815 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-735a4a61-a626-4440-a524-47f2e7fb9366 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:30.495512 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-735a4a61-a626-4440-a524-47f2e7fb9366 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:30.502223 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-735a4a61-a626-4440-a524-47f2e7fb9366 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:30.502673 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-735a4a61-a626-4440-a524-47f2e7fb9366 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:30.503493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-735a4a61-a626-4440-a524-47f2e7fb9366 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:30.503926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-735a4a61-a626-4440-a524-47f2e7fb9366 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:30.581166 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4baa780d-65b5-419b-a28c-c7de91a884b1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:30.588641 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4baa780d-65b5-419b-a28c-c7de91a884b1 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1673 microversion: 2.1 time: 0.153710 Jun 22 17:07:30.589200 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 342/699] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:30 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:30.636033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-735a4a61-a626-4440-a524-47f2e7fb9366 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:30.644192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-735a4a61-a626-4440-a524-47f2e7fb9366 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.153524 Jun 22 17:07:30.644755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 358/700] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:30 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:07:31.606119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-98a4d6f8-d00a-4db0-a33f-d57313bb161d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:31.606753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-98a4d6f8-d00a-4db0-a33f-d57313bb161d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:31.613192 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-98a4d6f8-d00a-4db0-a33f-d57313bb161d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:31.613642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-98a4d6f8-d00a-4db0-a33f-d57313bb161d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:31.614403 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-98a4d6f8-d00a-4db0-a33f-d57313bb161d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:31.614857 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-98a4d6f8-d00a-4db0-a33f-d57313bb161d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:31.662116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f6f78a2f-3377-43da-9047-5891b4180ec2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:31.662727 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f6f78a2f-3377-43da-9047-5891b4180ec2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:31.669299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f6f78a2f-3377-43da-9047-5891b4180ec2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:31.669747 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f6f78a2f-3377-43da-9047-5891b4180ec2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:31.671039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f6f78a2f-3377-43da-9047-5891b4180ec2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:31.671473 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f6f78a2f-3377-43da-9047-5891b4180ec2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:31.740807 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-98a4d6f8-d00a-4db0-a33f-d57313bb161d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:31.748275 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-98a4d6f8-d00a-4db0-a33f-d57313bb161d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1673 microversion: 2.1 time: 0.145961 Jun 22 17:07:31.751872 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 343/701] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:31 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:07:31.865737 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f6f78a2f-3377-43da-9047-5891b4180ec2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:31.873154 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f6f78a2f-3377-43da-9047-5891b4180ec2 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.215083 Jun 22 17:07:31.873728 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 359/702] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:31 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:07:32.766552 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c03e94ea-d824-4b49-9250-45404f2de058 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:32.767102 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c03e94ea-d824-4b49-9250-45404f2de058 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:32.774500 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c03e94ea-d824-4b49-9250-45404f2de058 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:32.775033 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c03e94ea-d824-4b49-9250-45404f2de058 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:32.775915 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c03e94ea-d824-4b49-9250-45404f2de058 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:32.776560 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c03e94ea-d824-4b49-9250-45404f2de058 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:32.846942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c03e94ea-d824-4b49-9250-45404f2de058 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:32.854823 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c03e94ea-d824-4b49-9250-45404f2de058 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1606 microversion: 2.1 time: 0.092112 Jun 22 17:07:32.856037 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 344/703] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:32 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:32.891606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8ad45f58-75db-4dd3-8af8-e4ab7b10e445 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:32.892505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8ad45f58-75db-4dd3-8af8-e4ab7b10e445 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:32.898942 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ad45f58-75db-4dd3-8af8-e4ab7b10e445 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:32.899647 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ad45f58-75db-4dd3-8af8-e4ab7b10e445 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:32.900627 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ad45f58-75db-4dd3-8af8-e4ab7b10e445 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:32.901239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8ad45f58-75db-4dd3-8af8-e4ab7b10e445 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:32.924072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-e0152e26-8a66-4114-af00-72c93adb5254 req-7fc9f89e-3827-4a7a-bb9a-4133a862f160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5168389e-f141-4e31-9c66-a365b612cd02", "name": "network-vif-deleted", "tag": "3454e07e-a024-4526-ac2b-c399f260725f"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:32.932576 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-e0152e26-8a66-4114-af00-72c93adb5254 req-7fc9f89e-3827-4a7a-bb9a-4133a862f160 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:32.933247 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-e0152e26-8a66-4114-af00-72c93adb5254 req-7fc9f89e-3827-4a7a-bb9a-4133a862f160 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:32.944547 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-e0152e26-8a66-4114-af00-72c93adb5254 req-7fc9f89e-3827-4a7a-bb9a-4133a862f160 service nova] Creating event network-vif-deleted:3454e07e-a024-4526-ac2b-c399f260725f for instance 5168389e-f141-4e31-9c66-a365b612cd02 on hv-cinder-81045 Jun 22 17:07:32.949961 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-e0152e26-8a66-4114-af00-72c93adb5254 req-7fc9f89e-3827-4a7a-bb9a-4133a862f160 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030328 Jun 22 17:07:32.950546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 345/704] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:07:33.048375 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8ad45f58-75db-4dd3-8af8-e4ab7b10e445 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:33.056339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8ad45f58-75db-4dd3-8af8-e4ab7b10e445 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.169773 Jun 22 17:07:33.061883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 360/705] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:32 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:33.874226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:33.874926 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:33.883586 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:33.883586 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:33.883586 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:33.883586 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:33.914341 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:33.914784 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:33.915226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lazy-loading 'fault' on Instance uuid 5168389e-f141-4e31-9c66-a365b612cd02 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:07:33.956773 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:33.964935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-28d64941-4166-41e2-a4b6-8bfdf402a3be tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 200 len: 1327 microversion: 2.1 time: 0.095405 Jun 22 17:07:33.965748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 346/706] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:33 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:34.073141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b1c26d2b-7e0c-44ef-b0e6-6056bca1b1cc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:34.073782 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b1c26d2b-7e0c-44ef-b0e6-6056bca1b1cc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:34.079957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1c26d2b-7e0c-44ef-b0e6-6056bca1b1cc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:34.080513 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1c26d2b-7e0c-44ef-b0e6-6056bca1b1cc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:34.081277 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1c26d2b-7e0c-44ef-b0e6-6056bca1b1cc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:34.081713 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1c26d2b-7e0c-44ef-b0e6-6056bca1b1cc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:34.212636 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b1c26d2b-7e0c-44ef-b0e6-6056bca1b1cc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:34.220692 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b1c26d2b-7e0c-44ef-b0e6-6056bca1b1cc tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.151533 Jun 22 17:07:34.221261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 361/707] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:34 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:34.982232 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:34.982781 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:34.989438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:34.989876 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:34.990643 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:34.991244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:35.007256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] HTTP exception thrown: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Request method failure captured: Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 HTTP/1.1 Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0rJf0J-OdOYNI4ZR5TNyByK9Hi5-TPMDaoaelt8WoFw-S2K_WNOAyBN7Ah90pq-pzezt8uY2Mor-rF8pntD34FjTz2lg3cNFIvW6_Sc5jNB_u1HCQPtIDv_kaZTEz6vzF2-q_2s6wB-oaBK84KTA-q55JqukQmGtZy-w7tju44sBKI Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:07:35.008989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 7c35fb18d4f44f26a6a0939503da0b0e Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:07:35.010528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '5168389e-f141-4e31-9c66-a365b612cd02'} Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:07:35.011389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:07:35.013245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:07:35.015158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Returning 404 to user: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:07:35.015158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-613f8a0c-8828-497d-859c-8af0a41a410b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 404 len: 111 microversion: 2.1 time: 0.032242 Jun 22 17:07:35.015342 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 347/708] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:34 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:07:35.022105 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9c70a8f7-b5ed-4a87-8137-b990064a22c8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '.version_select at 0x7fe0a02634c0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:35.118071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9c70a8f7-b5ed-4a87-8137-b990064a22c8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-869748818" status: 202 len: 0 microversion: 2.1 time: 0.101482 Jun 22 17:07:35.118813 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 362/709] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 22 17:07:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-869748818 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:07:35.238822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-30f6072b-b7f5-4fdd-99db-425ed0774b1a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:35.239462 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-30f6072b-b7f5-4fdd-99db-425ed0774b1a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:35.248279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-30f6072b-b7f5-4fdd-99db-425ed0774b1a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:35.249281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-30f6072b-b7f5-4fdd-99db-425ed0774b1a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:35.250044 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-30f6072b-b7f5-4fdd-99db-425ed0774b1a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:35.250478 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-30f6072b-b7f5-4fdd-99db-425ed0774b1a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:35.387625 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-30f6072b-b7f5-4fdd-99db-425ed0774b1a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:35.395321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-30f6072b-b7f5-4fdd-99db-425ed0774b1a tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.160565 Jun 22 17:07:35.395884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 348/710] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:35 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:35.879145 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7d0f3585-87ff-4e15-bdb8-7ec94543105a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'create', calling method: .version_select at 0x7fe0a10f95e0>, body: {"keypair": {"name": "tempest-keypair-2014570224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJObyx45TfcVCjurifi6dHytLuVzKCBqBX9TZD7DIug3Oh+wJp+0AiExPCiuXzz6fNk0Qp0upn7PgxVaKbb2OwbGsfga6XfBcbj+Nveikn8N0YhH1UG/zWBtRnKH+x8EvA=="}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:35.894169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-7d0f3585-87ff-4e15-bdb8-7ec94543105a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Getting quotas for project 0cdd096da8704dd3bc211b07e7f1f27e. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:07:35.897884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-7d0f3585-87ff-4e15-bdb8-7ec94543105a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Getting quotas for user 7c35fb18d4f44f26a6a0939503da0b0e and project 0cdd096da8704dd3bc211b07e7f1f27e. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:07:35.985919 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7d0f3585-87ff-4e15-bdb8-7ec94543105a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110680 Jun 22 17:07:35.986583 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 363/711] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:07:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:36.347593 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-02aadae3-88ed-4021-8a63-e98bfadbd252 req-b9cab236-d6a0-40a8-a5bf-19308184a16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2b04e-ad8d-4468-9f45-91ce07db3fbe", "name": "network-vif-plugged", "status": "completed", "tag": "d4c66ab3-2ffd-425f-9e48-6a35b15335cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:36.355928 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-02aadae3-88ed-4021-8a63-e98bfadbd252 req-b9cab236-d6a0-40a8-a5bf-19308184a16d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:36.356394 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-02aadae3-88ed-4021-8a63-e98bfadbd252 req-b9cab236-d6a0-40a8-a5bf-19308184a16d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:36.360748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:36.369522 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-02aadae3-88ed-4021-8a63-e98bfadbd252 req-b9cab236-d6a0-40a8-a5bf-19308184a16d service nova] Creating event network-vif-plugged:d4c66ab3-2ffd-425f-9e48-6a35b15335cd for instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe on hv-cinder-81045 Jun 22 17:07:36.372818 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-02aadae3-88ed-4021-8a63-e98bfadbd252 req-b9cab236-d6a0-40a8-a5bf-19308184a16d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028892 Jun 22 17:07:36.373460 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 349/712] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:36.413726 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a988f857-f64f-401e-9c9a-0e3071b17b53 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:36.414288 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a988f857-f64f-401e-9c9a-0e3071b17b53 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:36.429289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a988f857-f64f-401e-9c9a-0e3071b17b53 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:36.429289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a988f857-f64f-401e-9c9a-0e3071b17b53 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:36.429289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a988f857-f64f-401e-9c9a-0e3071b17b53 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:36.429289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a988f857-f64f-401e-9c9a-0e3071b17b53 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:36.575105 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a988f857-f64f-401e-9c9a-0e3071b17b53 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:36.582971 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a988f857-f64f-401e-9c9a-0e3071b17b53 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.174154 Jun 22 17:07:36.583551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 364/713] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:36 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:37.601951 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-73b5b2e8-fcfa-48d6-b10b-786c0fed40ed tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:37.602654 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-73b5b2e8-fcfa-48d6-b10b-786c0fed40ed tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:37.609552 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-73b5b2e8-fcfa-48d6-b10b-786c0fed40ed tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:37.610059 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-73b5b2e8-fcfa-48d6-b10b-786c0fed40ed tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:37.610822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-73b5b2e8-fcfa-48d6-b10b-786c0fed40ed tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:37.611253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-73b5b2e8-fcfa-48d6-b10b-786c0fed40ed tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:37.745650 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-73b5b2e8-fcfa-48d6-b10b-786c0fed40ed tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:37.753701 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-73b5b2e8-fcfa-48d6-b10b-786c0fed40ed tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1575 microversion: 2.1 time: 0.156869 Jun 22 17:07:37.754264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 350/714] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:37 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:38.205340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-198926227", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99c8c400-1daa-4f6f-b0dc-9ff6aced9b85"}], "security_groups": [{"name": "tempest-securitygroup--508351586"}], "key_name": "tempest-keypair-2014570224", "user_data": "}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:38.305106 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] validate_networks() for [('99c8c400-1daa-4f6f-b0dc-9ff6aced9b85', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:07:38.677363 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:07:38.677779 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:07:38.678242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:07:38.678644 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:07:38.679048 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:07:38.688588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:38.698313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:38.698313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:38.698313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:38.706662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Getting quotas for project 0cdd096da8704dd3bc211b07e7f1f27e. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:07:38.710641 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Getting quotas for user 7c35fb18d4f44f26a6a0939503da0b0e and project 0cdd096da8704dd3bc211b07e7f1f27e. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:07:38.721653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:07:38.723940 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:07:38.771184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f8e57173-9fbf-4690-98da-8c75a0d5cc80 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:38.771945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f8e57173-9fbf-4690-98da-8c75a0d5cc80 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:38.778799 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f8e57173-9fbf-4690-98da-8c75a0d5cc80 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:38.779245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f8e57173-9fbf-4690-98da-8c75a0d5cc80 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:38.780050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f8e57173-9fbf-4690-98da-8c75a0d5cc80 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:38.780539 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f8e57173-9fbf-4690-98da-8c75a0d5cc80 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:38.844305 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4e4608ab-7e66-4897-9c45-871d6350b6e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.643640 Jun 22 17:07:38.850073 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 365/715] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:07:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:07:38.855245 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-77306bd7-d7bc-425b-ad8d-8cdadda7cbcd tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:38.856096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-77306bd7-d7bc-425b-ad8d-8cdadda7cbcd tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:38.913086 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-77306bd7-d7bc-425b-ad8d-8cdadda7cbcd tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:38.916330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f8e57173-9fbf-4690-98da-8c75a0d5cc80 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:38.920501 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-77306bd7-d7bc-425b-ad8d-8cdadda7cbcd tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1237 microversion: 2.1 time: 0.069008 Jun 22 17:07:38.921096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 366/716] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:38 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:38.929443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f8e57173-9fbf-4690-98da-8c75a0d5cc80 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1562 microversion: 2.1 time: 0.157188 Jun 22 17:07:38.929443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 351/717] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:38 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:07:39.937393 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9e556348-75df-4b62-95b8-c033fdc09250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:39.938265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9e556348-75df-4b62-95b8-c033fdc09250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:39.944751 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e556348-75df-4b62-95b8-c033fdc09250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:39.945204 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e556348-75df-4b62-95b8-c033fdc09250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:39.945975 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e556348-75df-4b62-95b8-c033fdc09250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:39.946414 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9e556348-75df-4b62-95b8-c033fdc09250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:40.010356 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9e556348-75df-4b62-95b8-c033fdc09250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:40.018465 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9e556348-75df-4b62-95b8-c033fdc09250 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1233 microversion: 2.1 time: 0.085057 Jun 22 17:07:40.019021 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 367/718] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:39 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:41.035168 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3ef8dc46-02e8-4a98-b3cf-cd7d9b24a5a8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:41.036526 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3ef8dc46-02e8-4a98-b3cf-cd7d9b24a5a8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:41.043531 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ef8dc46-02e8-4a98-b3cf-cd7d9b24a5a8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:41.043987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ef8dc46-02e8-4a98-b3cf-cd7d9b24a5a8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:41.044898 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ef8dc46-02e8-4a98-b3cf-cd7d9b24a5a8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:41.045341 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ef8dc46-02e8-4a98-b3cf-cd7d9b24a5a8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:41.109620 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3ef8dc46-02e8-4a98-b3cf-cd7d9b24a5a8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:41.116990 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3ef8dc46-02e8-4a98-b3cf-cd7d9b24a5a8 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1295 microversion: 2.1 time: 0.085840 Jun 22 17:07:41.119574 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 352/719] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:41 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:07:42.134702 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-23cce196-9812-4d49-be59-75a437467205 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:42.136216 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-23cce196-9812-4d49-be59-75a437467205 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:42.148484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-23cce196-9812-4d49-be59-75a437467205 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:42.148484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-23cce196-9812-4d49-be59-75a437467205 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:42.148484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-23cce196-9812-4d49-be59-75a437467205 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:42.148484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-23cce196-9812-4d49-be59-75a437467205 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:42.302632 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-23cce196-9812-4d49-be59-75a437467205 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:42.312334 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-23cce196-9812-4d49-be59-75a437467205 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1362 microversion: 2.1 time: 0.181359 Jun 22 17:07:42.325259 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-b8ddcfcd-bb78-4c74-b6d2-f5d41bc3875f req-9be77378-f5de-4fb0-9a91-14e953d80ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d2c8aa6-43e1-43e3-9f31-4db4e63119c8", "tag": "12723d2a-5bc4-4712-9930-f22e6977da14"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:42.330801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 368/720] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:42 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:42.334253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b8ddcfcd-bb78-4c74-b6d2-f5d41bc3875f req-9be77378-f5de-4fb0-9a91-14e953d80ab2 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:42.334861 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b8ddcfcd-bb78-4c74-b6d2-f5d41bc3875f req-9be77378-f5de-4fb0-9a91-14e953d80ab2 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:42.346634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-b8ddcfcd-bb78-4c74-b6d2-f5d41bc3875f req-9be77378-f5de-4fb0-9a91-14e953d80ab2 service nova] Creating event network-changed:12723d2a-5bc4-4712-9930-f22e6977da14 for instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 on hv-cinder-81045 Jun 22 17:07:42.351913 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-b8ddcfcd-bb78-4c74-b6d2-f5d41bc3875f req-9be77378-f5de-4fb0-9a91-14e953d80ab2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030271 Jun 22 17:07:42.352540 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 353/721] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:43.329173 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8a018265-2385-49b2-a99b-0c8bab1b4f6c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:43.329730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8a018265-2385-49b2-a99b-0c8bab1b4f6c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:43.336151 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8a018265-2385-49b2-a99b-0c8bab1b4f6c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:43.336596 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8a018265-2385-49b2-a99b-0c8bab1b4f6c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:43.337345 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8a018265-2385-49b2-a99b-0c8bab1b4f6c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:43.337772 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8a018265-2385-49b2-a99b-0c8bab1b4f6c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:43.470366 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8a018265-2385-49b2-a99b-0c8bab1b4f6c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:43.477628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8a018265-2385-49b2-a99b-0c8bab1b4f6c tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1362 microversion: 2.1 time: 0.152413 Jun 22 17:07:43.478181 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 369/722] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:43 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:44.495441 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e9cb188c-a4f9-492f-80e5-b6beef421b45 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:44.496155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e9cb188c-a4f9-492f-80e5-b6beef421b45 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:44.502871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9cb188c-a4f9-492f-80e5-b6beef421b45 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:44.503319 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9cb188c-a4f9-492f-80e5-b6beef421b45 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:44.504073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9cb188c-a4f9-492f-80e5-b6beef421b45 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:44.504529 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9cb188c-a4f9-492f-80e5-b6beef421b45 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:44.629590 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e9cb188c-a4f9-492f-80e5-b6beef421b45 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:44.637233 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e9cb188c-a4f9-492f-80e5-b6beef421b45 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1362 microversion: 2.1 time: 0.146272 Jun 22 17:07:44.637542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 354/723] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:44 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:45.653598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1b044e0a-8dd3-4a83-9eb9-543f03685a65 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:45.654220 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1b044e0a-8dd3-4a83-9eb9-543f03685a65 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:45.661092 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1b044e0a-8dd3-4a83-9eb9-543f03685a65 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:45.661538 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1b044e0a-8dd3-4a83-9eb9-543f03685a65 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:45.662547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1b044e0a-8dd3-4a83-9eb9-543f03685a65 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:45.662974 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1b044e0a-8dd3-4a83-9eb9-543f03685a65 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:45.937635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1b044e0a-8dd3-4a83-9eb9-543f03685a65 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:45.944865 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1b044e0a-8dd3-4a83-9eb9-543f03685a65 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1362 microversion: 2.1 time: 0.295105 Jun 22 17:07:45.947043 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 370/724] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:45 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:46.965349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d507c9ea-6338-4a30-819d-7afa2321728f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:46.966536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d507c9ea-6338-4a30-819d-7afa2321728f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:46.978027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d507c9ea-6338-4a30-819d-7afa2321728f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:46.978762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d507c9ea-6338-4a30-819d-7afa2321728f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:46.980082 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d507c9ea-6338-4a30-819d-7afa2321728f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:46.980870 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d507c9ea-6338-4a30-819d-7afa2321728f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:47.131800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d507c9ea-6338-4a30-819d-7afa2321728f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:47.139148 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d507c9ea-6338-4a30-819d-7afa2321728f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1362 microversion: 2.1 time: 0.181139 Jun 22 17:07:47.139722 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 355/725] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:46 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:48.156293 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-70ebbcdc-13fe-4c8a-ba28-0c192e7cb87b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:48.156902 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-70ebbcdc-13fe-4c8a-ba28-0c192e7cb87b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:48.163602 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-70ebbcdc-13fe-4c8a-ba28-0c192e7cb87b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:48.164043 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-70ebbcdc-13fe-4c8a-ba28-0c192e7cb87b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:48.164817 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-70ebbcdc-13fe-4c8a-ba28-0c192e7cb87b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:48.165244 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-70ebbcdc-13fe-4c8a-ba28-0c192e7cb87b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:48.290277 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-70ebbcdc-13fe-4c8a-ba28-0c192e7cb87b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:48.297608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-70ebbcdc-13fe-4c8a-ba28-0c192e7cb87b tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1362 microversion: 2.1 time: 0.145791 Jun 22 17:07:48.298151 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 371/726] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:48 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:48.463062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-53502cc2-df7c-4690-9ce6-2e115a1e2222 req-b1a019b8-ee4f-4a94-8cce-7999dc4fa8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2c8aa6-43e1-43e3-9f31-4db4e63119c8", "name": "network-vif-plugged", "status": "completed", "tag": "12723d2a-5bc4-4712-9930-f22e6977da14"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:48.471480 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-53502cc2-df7c-4690-9ce6-2e115a1e2222 req-b1a019b8-ee4f-4a94-8cce-7999dc4fa8fe service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:48.471913 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-53502cc2-df7c-4690-9ce6-2e115a1e2222 req-b1a019b8-ee4f-4a94-8cce-7999dc4fa8fe service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:48.482624 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-53502cc2-df7c-4690-9ce6-2e115a1e2222 req-b1a019b8-ee4f-4a94-8cce-7999dc4fa8fe service nova] Creating event network-vif-plugged:12723d2a-5bc4-4712-9930-f22e6977da14 for instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 on hv-cinder-81045 Jun 22 17:07:48.487472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-53502cc2-df7c-4690-9ce6-2e115a1e2222 req-b1a019b8-ee4f-4a94-8cce-7999dc4fa8fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028062 Jun 22 17:07:48.488038 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 356/727] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:49.314112 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6c8197ef-8b98-4335-9f57-9bb445c34972 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:49.314720 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6c8197ef-8b98-4335-9f57-9bb445c34972 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:49.316651 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:49.317337 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=12 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:49.322465 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c8197ef-8b98-4335-9f57-9bb445c34972 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:49.322913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c8197ef-8b98-4335-9f57-9bb445c34972 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:49.323673 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c8197ef-8b98-4335-9f57-9bb445c34972 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:49.324125 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6c8197ef-8b98-4335-9f57-9bb445c34972 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:49.450271 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6c8197ef-8b98-4335-9f57-9bb445c34972 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:49.458101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6c8197ef-8b98-4335-9f57-9bb445c34972 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1362 microversion: 2.1 time: 0.148390 Jun 22 17:07:49.458652 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 372/728] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:49 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:50.475977 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ddaab681-f280-4f3a-a903-56e5fe1370e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:50.476759 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ddaab681-f280-4f3a-a903-56e5fe1370e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:50.482943 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ddaab681-f280-4f3a-a903-56e5fe1370e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:50.483617 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ddaab681-f280-4f3a-a903-56e5fe1370e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:50.484143 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ddaab681-f280-4f3a-a903-56e5fe1370e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:50.484576 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ddaab681-f280-4f3a-a903-56e5fe1370e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:50.613273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ddaab681-f280-4f3a-a903-56e5fe1370e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:07:50.620561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ddaab681-f280-4f3a-a903-56e5fe1370e4 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1547 microversion: 2.1 time: 0.149177 Jun 22 17:07:50.621113 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 357/729] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:07:50 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:07:50.636981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ad03e034-c792-4f23-b66e-983b226ae1b7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:07:50.637506 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ad03e034-c792-4f23-b66e-983b226ae1b7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:07:50.644548 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad03e034-c792-4f23-b66e-983b226ae1b7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:50.644992 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad03e034-c792-4f23-b66e-983b226ae1b7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:50.645746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad03e034-c792-4f23-b66e-983b226ae1b7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:50.646173 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad03e034-c792-4f23-b66e-983b226ae1b7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:50.724521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ad03e034-c792-4f23-b66e-983b226ae1b7 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091273 Jun 22 17:07:50.725092 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 373/730] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 17:07:50 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:07:51.961624 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-37ad315f-beed-4e27-8040-ec21a900f70b req-be89850a-823e-40d8-90b7-cf9caea793ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d2c8aa6-43e1-43e3-9f31-4db4e63119c8", "tag": "12723d2a-5bc4-4712-9930-f22e6977da14"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:07:51.965519 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=46 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:51.971297 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-37ad315f-beed-4e27-8040-ec21a900f70b req-be89850a-823e-40d8-90b7-cf9caea793ae service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:07:51.975716 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-37ad315f-beed-4e27-8040-ec21a900f70b req-be89850a-823e-40d8-90b7-cf9caea793ae service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:07:51.982381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-37ad315f-beed-4e27-8040-ec21a900f70b req-be89850a-823e-40d8-90b7-cf9caea793ae service nova] Creating event network-changed:12723d2a-5bc4-4712-9930-f22e6977da14 for instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 on hv-cinder-81045 Jun 22 17:07:51.987127 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-37ad315f-beed-4e27-8040-ec21a900f70b req-be89850a-823e-40d8-90b7-cf9caea793ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029156 Jun 22 17:07:51.987722 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 358/731] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:08:23.906957 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:08:23.907703 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:08:23.911620 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a29abd58-ea98-4b5c-a097-738f428781f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:23.912124 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a29abd58-ea98-4b5c-a097-738f428781f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:23.918247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a29abd58-ea98-4b5c-a097-738f428781f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:23.918784 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a29abd58-ea98-4b5c-a097-738f428781f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:23.919545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a29abd58-ea98-4b5c-a097-738f428781f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:23.919980 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a29abd58-ea98-4b5c-a097-738f428781f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:23.943143 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a29abd58-ea98-4b5c-a097-738f428781f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/ips" status: 200 len: 152 microversion: 2.20 time: 0.037675 Jun 22 17:08:23.945194 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 374/732] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Jun 22 17:08:23 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 17:08:27.141498 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=42 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:08:27.146128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-44bf1951-41af-4233-a97e-6274ad216d23 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:08:27.147319 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-44bf1951-41af-4233-a97e-6274ad216d23 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:27.153802 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44bf1951-41af-4233-a97e-6274ad216d23 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:27.154246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44bf1951-41af-4233-a97e-6274ad216d23 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:27.154993 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44bf1951-41af-4233-a97e-6274ad216d23 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:27.155424 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44bf1951-41af-4233-a97e-6274ad216d23 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:27.177352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-44bf1951-41af-4233-a97e-6274ad216d23 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lazy-loading 'flavor' on Instance uuid 78bb9410-a261-4625-ae42-6fe5e09a8d75 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:08:27.671707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-44bf1951-41af-4233-a97e-6274ad216d23 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/action" status: 202 len: 0 microversion: 2.20 time: 0.531733 Jun 22 17:08:27.672384 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 359/733] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 22 17:08:27 2022] POST /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:08:27.685958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:27.685958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:27.690253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:27.690717 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:27.691471 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:27.691894 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:27.818080 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:27.826883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:27.828416 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:27.830444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1db1240d-b38a-43cc-ace2-72531a83608e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.152736 Jun 22 17:08:27.830444 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 375/734] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:27 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:28.849079 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:28.849809 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:28.856147 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:28.856601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:28.857357 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:28.857792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:28.983351 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:28.991146 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:28.992702 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:28.993844 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e81fef57-7600-46dd-804c-206b537bed80 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.149603 Jun 22 17:08:28.994406 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 360/735] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:28 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:30.012484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:30.013096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:30.020530 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:30.020979 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:30.021818 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:30.022270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:30.148074 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:30.155795 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:30.157313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:30.158489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e97fbb95-abe0-4496-acf9-1b08bab6dba3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.149923 Jun 22 17:08:30.159032 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 376/736] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:30 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:31.177338 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:31.177960 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:31.184405 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:31.184849 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:31.185594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:31.186017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:31.315017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:31.322707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:31.324235 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:31.325365 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a6f897cc-25ae-4972-b6f8-333c565bcad4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.151884 Jun 22 17:08:31.325901 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 361/737] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:31 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:32.343782 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:32.369139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:32.369139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:32.369139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:32.369139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:32.369552 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:32.482588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:32.490384 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:32.491879 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:32.493074 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2300ef14-7b1f-4152-9b76-67256cc37efb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.153213 Jun 22 17:08:32.493619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 377/738] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:32 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:33.557681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:33.557681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:33.557681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:33.557681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:33.558516 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:33.558516 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:33.648405 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:33.656227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:33.657718 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:33.658850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e47376ac-9da1-44f9-bb64-f4e0060e3ba6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.152286 Jun 22 17:08:33.659395 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 362/739] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:33 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:34.677583 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:34.678786 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:34.685064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:34.685661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:34.686421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:34.686855 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:34.814080 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:34.821977 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:34.823472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:34.824649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b15b0b08-88ea-4ba9-943e-7834ecaa492f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.151230 Jun 22 17:08:34.825464 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 378/740] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:34 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:35.842117 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:35.842710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:35.849078 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:35.849522 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:35.850919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:35.851352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:35.976051 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:35.983763 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:35.985266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:35.986406 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b32aee86-37cb-4e5f-8a8f-c7acbb08025e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.148179 Jun 22 17:08:35.986942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 363/741] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:35 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:37.004059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:37.004688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:37.012187 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:37.012642 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:37.013426 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:37.013882 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:37.143648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:37.152046 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:37.153638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:37.154789 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a65292f1-a8cf-4a26-a42a-ce4f53e0afaf tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.154688 Jun 22 17:08:37.156532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 379/742] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:36 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:38.173964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:38.174579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:38.181358 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:38.181799 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:38.182548 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:38.182975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:38.309939 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:38.317603 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:38.319587 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:38.320760 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-525d7c0c-3b74-48bd-8540-11bd0e13db3c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.150691 Jun 22 17:08:38.321308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 364/743] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:38 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:39.338752 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:39.339285 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:39.345785 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:39.351723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:39.351723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:39.351723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:39.474137 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:39.481939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:39.483440 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:39.484628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b19e7f04-bcb8-48f7-ac62-de0272164a26 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.149936 Jun 22 17:08:39.485180 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 380/744] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:39 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:40.502947 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:40.503586 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:40.509951 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:40.510406 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:40.511167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:40.511607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:40.638123 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:40.647768 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:40.647768 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:40.648867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ea8738cd-999d-4884-b234-97296e953d24 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1745 microversion: 2.20 time: 0.149784 Jun 22 17:08:40.649419 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 365/745] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:40 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:41.668062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:41.668621 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:41.675057 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:41.675502 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:41.676291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:41.676719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:41.801372 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:41.809303 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:41.810787 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:41.811939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7f7109fb-5909-4e7b-aebb-9e9e9a43319b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1745 microversion: 2.20 time: 0.148776 Jun 22 17:08:41.812511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 381/746] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:41 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:42.660839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-fda1e227-d512-4587-9a28-3ed6a0c889ec req-627d8801-8d35-4398-820a-0b22eb5eef9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bb9410-a261-4625-ae42-6fe5e09a8d75", "name": "network-vif-plugged", "status": "completed", "tag": "a1e73d37-f445-4221-9965-5b010394558b"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:08:42.670141 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fda1e227-d512-4587-9a28-3ed6a0c889ec req-627d8801-8d35-4398-820a-0b22eb5eef9d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:42.670584 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fda1e227-d512-4587-9a28-3ed6a0c889ec req-627d8801-8d35-4398-820a-0b22eb5eef9d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:42.682351 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-fda1e227-d512-4587-9a28-3ed6a0c889ec req-627d8801-8d35-4398-820a-0b22eb5eef9d service nova] Creating event network-vif-plugged:a1e73d37-f445-4221-9965-5b010394558b for instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 on hv-cinder-81045 Jun 22 17:08:42.687379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-fda1e227-d512-4587-9a28-3ed6a0c889ec req-627d8801-8d35-4398-820a-0b22eb5eef9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030255 Jun 22 17:08:42.691429 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 366/747] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:08:42.830799 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:42.831413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:42.837883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:42.841145 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:42.841145 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:42.841145 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:42.968972 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:42.977436 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:42.978939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:42.980097 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-94b5cd1b-6365-4c1c-b5e8-77660632f695 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1745 microversion: 2.20 time: 0.153246 Jun 22 17:08:42.980794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 382/748] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:42 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:43.998226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:43.998920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:44.005801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:44.006246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:44.007585 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:44.008019 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:44.137002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:44.144695 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:44.146170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:44.147299 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-afa2e829-00a5-49a4-b622-4aa58fb1ea2f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1745 microversion: 2.20 time: 0.153748 Jun 22 17:08:44.148524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 367/749] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:43 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:45.166241 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:45.166816 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:45.173713 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:45.174159 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:45.174916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:45.175343 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:45.305494 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:45.313527 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:45.315061 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:45.316287 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-02ba8f33-8234-4720-887c-a728614aa062 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1745 microversion: 2.20 time: 0.154356 Jun 22 17:08:45.316838 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 383/750] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:45 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:46.335554 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:46.336340 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:46.343225 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:46.343880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:46.344867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:46.345302 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:46.487917 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:46.496075 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:46.497669 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:46.498832 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fed11de7-08dc-4150-9daa-3faaa9084974 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.167712 Jun 22 17:08:46.499380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 368/751] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:46 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:08:47.518200 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:47.519020 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:47.525982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:47.526432 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:47.527196 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:47.527628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:47.679851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:47.689023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:47.690529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:47.691698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-926bd5fe-d343-4bfa-bbbf-75f3b14f42e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.177795 Jun 22 17:08:47.692279 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 384/752] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:47 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:48.711558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:48.712217 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:48.718943 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:48.719392 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:48.720177 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:48.720613 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:48.858002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:48.866867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:48.868389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:48.869563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7d1947b4-7cfe-41bf-88b4-f52f4065663d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.162540 Jun 22 17:08:48.870150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 369/753] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:48 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:49.889511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:49.891140 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:49.899608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:49.900167 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:49.901023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:49.901472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:50.243691 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:50.252877 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:50.254532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:50.255924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b50a0854-43cf-424d-8cda-657167f4c315 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.372590 Jun 22 17:08:50.268250 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 385/754] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:49 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:51.275791 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:51.276380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:51.283085 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:51.283536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:51.284346 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:51.284783 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:51.479944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:51.487825 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:51.489331 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:51.490471 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0262c120-af02-412b-8f6a-55bdf02243e3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.218743 Jun 22 17:08:51.491797 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 370/755] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:51 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:52.509284 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:52.509895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:52.517199 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:52.518060 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:52.519062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:52.519505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:52.710135 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:52.722051 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:52.723662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:52.724878 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-44380ac5-1691-4696-9eca-c1bbbd8df78b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.219923 Jun 22 17:08:52.725460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 386/756] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:52 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:08:53.744540 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:53.745133 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:53.751849 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:53.752324 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:53.753272 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:53.753878 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:53.915862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:53.924646 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:53.925861 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:53.927282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7afaf997-22f9-42cd-ac46-32628201c1a3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.187305 Jun 22 17:08:53.938888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 371/757] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:53 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:54.946096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:54.946703 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:54.953208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:54.953658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:54.954413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:54.954852 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:55.088095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:55.096059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:55.097570 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:55.098714 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2ebce765-cfbf-48fb-be29-e448b36b67a6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.157187 Jun 22 17:08:55.099256 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 387/758] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:54 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:56.117962 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:56.118600 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:56.124877 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:56.125327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:56.126092 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:56.126531 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:56.259558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:56.268654 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:56.270179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:56.271328 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bba19879-052b-4837-b8a0-4e66b4a496d3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1740 microversion: 2.20 time: 0.157846 Jun 22 17:08:56.271883 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 372/759] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:56 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:57.291101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:57.291642 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:57.298260 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:57.298709 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:57.299466 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:57.299900 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:57.462704 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:57.470751 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:57.472273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:57.473437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c40d9c07-074b-4a29-b48e-1c669dc47c73 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1722 microversion: 2.20 time: 0.187189 Jun 22 17:08:57.473988 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 388/760] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:57 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:58.492056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:58.493278 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:58.495658 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=30 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:08:58.500430 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:58.500874 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:58.501627 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:58.502054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:58.505844 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:08:58.628615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:58.636391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:58.637895 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:58.639050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3dd59ec6-1e41-4438-9937-c3164fa4290d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1722 microversion: 2.20 time: 0.150834 Jun 22 17:08:58.639601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 373/761] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:58 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:08:59.657367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:08:59.658033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:08:59.664914 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:59.665367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:59.666134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:08:59.666569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:08:59.801186 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:59.810295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:59.812513 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:08:59.813679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-37744204-22cf-4777-8da2-52a381034787 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1722 microversion: 2.20 time: 0.160412 Jun 22 17:08:59.814237 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 389/762] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:08:59 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:00.830885 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:00.831618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:00.833723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-ed8691af-e089-43f7-8743-37834b52db23 req-8253c9c2-e4a3-4e97-93e5-18f896dc3467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bb9410-a261-4625-ae42-6fe5e09a8d75", "name": "network-vif-unplugged", "status": "completed", "tag": "a1e73d37-f445-4221-9965-5b010394558b"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:00.837740 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=33 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:00.838468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:00.838914 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:00.839672 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:00.840175 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:00.842947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-ed8691af-e089-43f7-8743-37834b52db23 req-8253c9c2-e4a3-4e97-93e5-18f896dc3467 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:00.843448 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-ed8691af-e089-43f7-8743-37834b52db23 req-8253c9c2-e4a3-4e97-93e5-18f896dc3467 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:00.847198 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=95 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:00.854944 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.compute.server_external_events [req-ed8691af-e089-43f7-8743-37834b52db23 req-8253c9c2-e4a3-4e97-93e5-18f896dc3467 service nova] Unable to find a host for instance 78bb9410-a261-4625-ae42-6fe5e09a8d75. Dropping event network-vif-unplugged {{(pid=118471) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 17:09:00.855822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-ed8691af-e089-43f7-8743-37834b52db23 req-8253c9c2-e4a3-4e97-93e5-18f896dc3467 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026230 Jun 22 17:09:00.856607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 390/763] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 17:09:00.972954 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:00.981374 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:00.982856 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:00.983987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9bcfb60f-239d-40cc-bde3-722b4972e8f6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1665 microversion: 2.20 time: 0.157195 Jun 22 17:09:00.984555 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 374/764] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:00 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:01.001887 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-320ba282-f799-48f3-b28e-856a685c0054 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dae5b23a-9441-463e-bb3c-1be5cecbd70d"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:01.002929 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-320ba282-f799-48f3-b28e-856a685c0054 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:01.009599 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-320ba282-f799-48f3-b28e-856a685c0054 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:01.010040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-320ba282-f799-48f3-b28e-856a685c0054 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:01.010795 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-320ba282-f799-48f3-b28e-856a685c0054 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:01.011226 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-320ba282-f799-48f3-b28e-856a685c0054 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:01.970680 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-320ba282-f799-48f3-b28e-856a685c0054 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.973142 Jun 22 17:09:01.971289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 391/765] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Jun 22 17:09:00 2022] POST /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments => generated 188 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 17:09:02.093113 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6068e5e6-4d22-42a6-99fc-9109d223b92f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:02.093681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6068e5e6-4d22-42a6-99fc-9109d223b92f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:02.100295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6068e5e6-4d22-42a6-99fc-9109d223b92f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:02.100748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6068e5e6-4d22-42a6-99fc-9109d223b92f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:02.101573 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6068e5e6-4d22-42a6-99fc-9109d223b92f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:02.102011 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6068e5e6-4d22-42a6-99fc-9109d223b92f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:02.353424 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6068e5e6-4d22-42a6-99fc-9109d223b92f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/action" status: 202 len: 0 microversion: 2.20 time: 0.264201 Jun 22 17:09:02.354036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 375/766] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 22 17:09:02 2022] POST /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:09:02.362194 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:02.362800 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:02.368838 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:02.369276 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:02.370569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:02.370998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:02.500539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:02.508967 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:02.511120 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:02.512315 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-56c7f09a-fbfa-48df-aef1-7eb764826b52 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1751 microversion: 2.20 time: 0.154196 Jun 22 17:09:02.512860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 392/767] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:02 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:03.531311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:03.531949 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:03.541679 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:03.542128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:03.542902 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:03.543338 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:03.676917 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:03.685317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:03.686821 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:03.687980 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ebdeb035-d6d4-49bf-bf3b-9935e2d0a3cb tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1751 microversion: 2.20 time: 0.160681 Jun 22 17:09:03.688572 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 376/768] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:03 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:04.706688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:04.707298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:04.713876 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:04.714297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:04.715052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:04.715488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:04.849269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:04.858392 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:04.860035 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:04.861275 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b1167387-52dd-4f37-8488-e3bb8d5b6b83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1753 microversion: 2.20 time: 0.158684 Jun 22 17:09:04.862897 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 393/769] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:04 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:05.880305 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:05.880910 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:05.887798 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:05.888325 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:05.889102 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:05.889535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:06.017652 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:06.026515 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:06.028017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:06.029199 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f72a8a57-bd95-473c-a169-9347ee135daa tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.152849 Jun 22 17:09:06.029920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 377/770] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:05 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:07.047045 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:07.048830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:07.061636 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:07.062192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:07.063297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:07.063885 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:07.147537 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9f40f326-ebbb-4a35-b126-83859bd70ef3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:07.148387 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9f40f326-ebbb-4a35-b126-83859bd70ef3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:07.155536 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f40f326-ebbb-4a35-b126-83859bd70ef3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:07.155990 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f40f326-ebbb-4a35-b126-83859bd70ef3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:07.157364 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f40f326-ebbb-4a35-b126-83859bd70ef3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:07.158244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f40f326-ebbb-4a35-b126-83859bd70ef3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:07.204867 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9f40f326-ebbb-4a35-b126-83859bd70ef3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/ips" status: 200 len: 145 microversion: 2.1 time: 0.061130 Jun 22 17:09:07.205677 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 378/771] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 17:09:07 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/ips => generated 145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:07.266980 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:07.278222 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:07.280262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:07.281443 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3a10b6da-fd34-4e8d-a48f-b4907e8461b7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.238266 Jun 22 17:09:07.281990 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 394/772] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:07 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:08.303804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:08.304507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:08.311631 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:08.312020 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:08.312822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:08.313254 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:08.446986 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:08.456385 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:08.457870 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:08.459231 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-54cb768c-a096-496f-87e3-873800db8584 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.159297 Jun 22 17:09:08.459946 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 379/773] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:08 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:09.478958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:09.479566 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:09.486728 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:09.487252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:09.488098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:09.488628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:09.629920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:09.639051 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:09.640846 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:09.642032 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-aad042b8-1262-42a7-abe8-e6d967b1cfd2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.167055 Jun 22 17:09:09.642822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 395/774] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:09 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:09.957384 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d604b3eb-7730-49de-8b24-ff3e211fee79 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64c4e728-73c4-4cc4-9ae5-0befdddba622"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:09.958548 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d604b3eb-7730-49de-8b24-ff3e211fee79 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:09.966349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d604b3eb-7730-49de-8b24-ff3e211fee79 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:09.967116 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d604b3eb-7730-49de-8b24-ff3e211fee79 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:09.968125 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d604b3eb-7730-49de-8b24-ff3e211fee79 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:09.968561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d604b3eb-7730-49de-8b24-ff3e211fee79 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:10.662117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:10.663885 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:10.670759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:10.672290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:10.672290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:10.672511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:10.815507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:10.825644 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:10.827408 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:10.828753 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e3c07074-a8b3-47bb-a1bc-52dad1c0162d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.170735 Jun 22 17:09:10.829386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 396/775] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:10 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:11.848231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:11.849110 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:11.856744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:11.857439 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:11.858432 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:11.859096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:11.998325 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:12.006884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:12.008451 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:12.009626 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f750a549-1090-4487-8a8f-e64c1b8afa01 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.165358 Jun 22 17:09:12.010207 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 397/776] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:11 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:13.030705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:13.031343 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:13.038001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:13.038857 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:13.039628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:13.040057 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:13.177660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:13.186796 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:13.188319 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:13.189517 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d439654a-1a54-4213-b85b-90db54a3a44d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.165514 Jun 22 17:09:13.190311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 398/777] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:13 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:14.209660 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:14.210656 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:14.216718 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:14.217164 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:14.218070 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:14.218661 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:14.381687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:14.390479 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:14.392872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:14.393227 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7edfd0d2-d189-493b-b18b-e3a104dc8061 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.188124 Jun 22 17:09:14.393991 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 399/778] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:14 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:15.412127 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:15.412866 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:15.419931 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:15.420395 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:15.421187 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:15.421564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:15.557212 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:15.565981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:15.567494 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:15.568757 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3a507cb1-ab41-453d-bada-1a2cbbaf042e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.160476 Jun 22 17:09:15.569309 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 400/779] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:15 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:15.864365 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-82fa7b8e-5f5a-4367-8948-a5ccbf214b7b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:15.869338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-82fa7b8e-5f5a-4367-8948-a5ccbf214b7b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:15.871494 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-82fa7b8e-5f5a-4367-8948-a5ccbf214b7b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:15.872017 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-82fa7b8e-5f5a-4367-8948-a5ccbf214b7b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:15.872880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-82fa7b8e-5f5a-4367-8948-a5ccbf214b7b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:15.873384 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-82fa7b8e-5f5a-4367-8948-a5ccbf214b7b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:15.898412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-82fa7b8e-5f5a-4367-8948-a5ccbf214b7b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:09:16.105461 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-82fa7b8e-5f5a-4367-8948-a5ccbf214b7b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 204 len: 0 microversion: 2.1 time: 0.244612 Jun 22 17:09:16.106157 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 401/780] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:09:15 2022] DELETE /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 17:09:16.111244 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-482b076a-4838-4459-95ff-f9a738541c59 req-a50e5502-e299-4d57-bafb-4772c74f2977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c2b04e-ad8d-4468-9f45-91ce07db3fbe", "tag": "d4c66ab3-2ffd-425f-9e48-6a35b15335cd"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:16.120646 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-482b076a-4838-4459-95ff-f9a738541c59 req-a50e5502-e299-4d57-bafb-4772c74f2977 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:16.121087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-482b076a-4838-4459-95ff-f9a738541c59 req-a50e5502-e299-4d57-bafb-4772c74f2977 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:16.134587 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-482b076a-4838-4459-95ff-f9a738541c59 req-a50e5502-e299-4d57-bafb-4772c74f2977 service nova] Creating event network-changed:d4c66ab3-2ffd-425f-9e48-6a35b15335cd for instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe on hv-cinder-81045 Jun 22 17:09:16.140029 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-482b076a-4838-4459-95ff-f9a738541c59 req-a50e5502-e299-4d57-bafb-4772c74f2977 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032590 Jun 22 17:09:16.140649 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 402/781] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:16.145484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5d434cc7-d13f-4b98-972e-732bce7e7b04 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:16.146165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5d434cc7-d13f-4b98-972e-732bce7e7b04 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:16.152129 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d434cc7-d13f-4b98-972e-732bce7e7b04 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:16.152579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d434cc7-d13f-4b98-972e-732bce7e7b04 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:16.153329 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d434cc7-d13f-4b98-972e-732bce7e7b04 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:16.153753 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5d434cc7-d13f-4b98-972e-732bce7e7b04 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:16.283930 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5d434cc7-d13f-4b98-972e-732bce7e7b04 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:16.286283 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:16.293055 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5d434cc7-d13f-4b98-972e-732bce7e7b04 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.151329 Jun 22 17:09:16.293620 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 403/782] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:16 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:09:16.590055 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:16.590671 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:16.596672 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:16.597120 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:16.597918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:16.598351 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:16.736788 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:16.745843 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:16.747386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:16.748597 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bf807ab4-af60-4d5b-a01e-232e7a312fdd tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.165196 Jun 22 17:09:16.749407 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 404/783] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:16 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:17.311230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4ee03c3f-84ef-489c-ae60-d302bdeba636 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:17.311864 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4ee03c3f-84ef-489c-ae60-d302bdeba636 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:17.318224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4ee03c3f-84ef-489c-ae60-d302bdeba636 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:17.318750 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4ee03c3f-84ef-489c-ae60-d302bdeba636 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:17.319511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4ee03c3f-84ef-489c-ae60-d302bdeba636 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:17.319942 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4ee03c3f-84ef-489c-ae60-d302bdeba636 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:17.451958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4ee03c3f-84ef-489c-ae60-d302bdeba636 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:17.459332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4ee03c3f-84ef-489c-ae60-d302bdeba636 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.152707 Jun 22 17:09:17.459888 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 405/784] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:17 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:09:17.766880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:17.767521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:17.773823 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:17.774270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:17.775020 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:17.775449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:17.903607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:17.911783 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:17.913307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:17.914709 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2fb3775e-6718-4535-a13a-237af1b18bdc tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.151596 Jun 22 17:09:17.915292 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 406/785] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:17 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:18.476406 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-78ed0df6-66e2-4662-9328-b087a7b26277 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:18.476933 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-78ed0df6-66e2-4662-9328-b087a7b26277 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:18.483344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78ed0df6-66e2-4662-9328-b087a7b26277 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:18.483792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78ed0df6-66e2-4662-9328-b087a7b26277 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:18.484586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78ed0df6-66e2-4662-9328-b087a7b26277 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:18.485083 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-78ed0df6-66e2-4662-9328-b087a7b26277 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:18.614667 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-78ed0df6-66e2-4662-9328-b087a7b26277 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:18.622735 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-78ed0df6-66e2-4662-9328-b087a7b26277 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.150391 Jun 22 17:09:18.623318 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 407/786] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:18 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:09:18.933150 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:18.933802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:18.940270 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:18.940743 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:18.941490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:18.941933 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:19.067607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:19.075950 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:19.077490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:19.078656 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-35de75bd-751b-4580-8ca1-1c1c36cbc5d8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.149422 Jun 22 17:09:19.079221 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 408/787] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:18 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:19.640920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d760f624-fcae-4abd-899e-6f2a2d1a8940 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:19.649790 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d760f624-fcae-4abd-899e-6f2a2d1a8940 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:19.649790 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d760f624-fcae-4abd-899e-6f2a2d1a8940 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:19.649790 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d760f624-fcae-4abd-899e-6f2a2d1a8940 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:19.649790 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d760f624-fcae-4abd-899e-6f2a2d1a8940 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:19.650180 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d760f624-fcae-4abd-899e-6f2a2d1a8940 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:19.779684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d760f624-fcae-4abd-899e-6f2a2d1a8940 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:19.787545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d760f624-fcae-4abd-899e-6f2a2d1a8940 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.150460 Jun 22 17:09:19.796254 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 409/788] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:19 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:09:19.966797 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=17 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:20.097128 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:20.097737 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:20.104615 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:20.105076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:20.105836 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:20.106267 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:20.238560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:20.247658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:20.249191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:20.250354 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ff7bf841-7377-4651-8904-20473fb120fe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.157123 Jun 22 17:09:20.250913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 410/789] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:20 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:20.252357 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d604b3eb-7730-49de-8b24-ff3e211fee79 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.298710 Jun 22 17:09:20.253013 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 380/790] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:09:09 2022] POST /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments => generated 194 bytes in 10300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:20.803849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fe4ab572-2794-4b01-94f3-b8409bcdbb12 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:20.804496 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fe4ab572-2794-4b01-94f3-b8409bcdbb12 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:20.810462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe4ab572-2794-4b01-94f3-b8409bcdbb12 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:20.810916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe4ab572-2794-4b01-94f3-b8409bcdbb12 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:20.811679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe4ab572-2794-4b01-94f3-b8409bcdbb12 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:20.812137 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fe4ab572-2794-4b01-94f3-b8409bcdbb12 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:20.939855 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fe4ab572-2794-4b01-94f3-b8409bcdbb12 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:20.947370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fe4ab572-2794-4b01-94f3-b8409bcdbb12 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.147434 Jun 22 17:09:20.948601 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 411/791] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:20 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:09:21.267964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:21.268696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:21.275404 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:21.275929 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:21.276693 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:21.277129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:21.412801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:21.422124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:21.423550 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:21.424728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c353d77a-9eee-4288-984a-6f9163fb8dfe tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.160994 Jun 22 17:09:21.425283 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 381/792] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:21 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:21.966349 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-437be3d2-435d-4b14-96ea-067bf881d566 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:21.967423 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-437be3d2-435d-4b14-96ea-067bf881d566 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:21.975422 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-437be3d2-435d-4b14-96ea-067bf881d566 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:21.975878 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-437be3d2-435d-4b14-96ea-067bf881d566 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:21.976685 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-437be3d2-435d-4b14-96ea-067bf881d566 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:21.977123 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-437be3d2-435d-4b14-96ea-067bf881d566 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:22.130824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-437be3d2-435d-4b14-96ea-067bf881d566 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:22.138561 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-437be3d2-435d-4b14-96ea-067bf881d566 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1568 microversion: 2.1 time: 0.177152 Jun 22 17:09:22.139111 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 412/793] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:21 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:09:22.305080 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-dc3f429e-5317-4404-bdbb-7006fd501310 req-9fb51bef-4b19-48f0-8565-67bc0998d4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c2b04e-ad8d-4468-9f45-91ce07db3fbe", "name": "network-vif-deleted", "tag": "d4c66ab3-2ffd-425f-9e48-6a35b15335cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:22.313608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-dc3f429e-5317-4404-bdbb-7006fd501310 req-9fb51bef-4b19-48f0-8565-67bc0998d4df service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:22.314028 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-dc3f429e-5317-4404-bdbb-7006fd501310 req-9fb51bef-4b19-48f0-8565-67bc0998d4df service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:22.326925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-dc3f429e-5317-4404-bdbb-7006fd501310 req-9fb51bef-4b19-48f0-8565-67bc0998d4df service nova] Creating event network-vif-deleted:d4c66ab3-2ffd-425f-9e48-6a35b15335cd for instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe on hv-cinder-81045 Jun 22 17:09:22.331639 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-dc3f429e-5317-4404-bdbb-7006fd501310 req-9fb51bef-4b19-48f0-8565-67bc0998d4df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030209 Jun 22 17:09:22.332239 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 382/794] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:22.443213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:22.443843 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:22.450226 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:22.450683 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:22.451447 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:22.451882 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:22.587172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:22.596183 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:22.597790 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:22.598999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0a06c8eb-a320-486c-8488-187577800a7e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.159639 Jun 22 17:09:22.599550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 413/795] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:22 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:23.155417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-62b7b1ea-a649-4b7b-b76d-e45228aa3310 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:23.156270 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-62b7b1ea-a649-4b7b-b76d-e45228aa3310 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:23.162924 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62b7b1ea-a649-4b7b-b76d-e45228aa3310 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:23.163400 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62b7b1ea-a649-4b7b-b76d-e45228aa3310 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:23.164461 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62b7b1ea-a649-4b7b-b76d-e45228aa3310 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:23.164900 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62b7b1ea-a649-4b7b-b76d-e45228aa3310 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:23.230665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-62b7b1ea-a649-4b7b-b76d-e45228aa3310 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd8f30d0f834973a0e9f5d8dfc1a9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f13e36c374b3ca47073594406fe26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:23.238203 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-62b7b1ea-a649-4b7b-b76d-e45228aa3310 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 200 len: 1219 microversion: 2.1 time: 0.087143 Jun 22 17:09:23.242709 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 383/796] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:23 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:09:23.616906 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:23.617560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:23.624940 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:23.625507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:23.626413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:23.627096 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:23.760261 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:23.769656 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:23.771832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:23.773034 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0c2cf18a-bf7a-4b17-8f23-5b43d64874d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.160119 Jun 22 17:09:23.773586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 414/797] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:23 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:24.254963 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:24.255566 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] [instance: 66c2b04e-ad8d-4468-9f45-91ce07db3fbe] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:24.266967 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:24.267428 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:24.268541 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:24.268976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:24.282772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] HTTP exception thrown: Instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe could not be found. Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Request method failure captured: Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe HTTP/1.1 Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0s1yFXm8u6HkLq_i3g0huNtGYJzZ2NceylTiiOhOQapuJyQg6UBvVppCv7p0rfIyuOt0IfiyjyahfBkR8yH8qGegVxQIq0U8OjC0_gYax85xaKWQC0GIjXhVBPvRo35iJOOUZm0nv5F_OKhlwBAEWzu2mvEDiBNHb-vM-nr1-1NLuc Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 053f13e36c374b3ca47073594406fe26 Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-TestShelveInstance-596065701 Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:09:24.284413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/053f13e36c374b3ca47073594406fe26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_053f13e36c374b3ca47073594406fe26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/053f13e36c374b3ca47073594406fe26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/053f13e36c374b3ca47073594406fe26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-TestShelveInstance-596065701 Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 053f13e36c374b3ca47073594406fe26 Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-TestShelveInstance-596065701 Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-TestShelveInstance-596065701-project Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 4bd8f30d0f834973a0e9f5d8dfc1a9ee Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-TestShelveInstance-596065701-project Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe could not be found. Jun 22 17:09:24.286076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '66c2b04e-ad8d-4468-9f45-91ce07db3fbe'} Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe could not be found. Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:09:24.287061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe could not be found. Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe could not be found. Jun 22 17:09:24.289035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:24.290589 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Returning 404 to user: Instance 66c2b04e-ad8d-4468-9f45-91ce07db3fbe could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:09:24.290589 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-784d46e6-8226-4f35-b8dc-6dc4c98fe95b tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe" status: 404 len: 111 microversion: 2.1 time: 0.034688 Jun 22 17:09:24.290589 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 384/798] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:24 2022] GET /compute/v2.1/servers/66c2b04e-ad8d-4468-9f45-91ce07db3fbe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:09:24.516762 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-564283ea-43ec-47c8-a185-cac6986aff35 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] Calling method '.version_select at 0x7fe0a045b430>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:24.592233 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-564283ea-43ec-47c8-a185-cac6986aff35 tempest-TestShelveInstance-596065701 tempest-TestShelveInstance-596065701-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-537064178" status: 202 len: 0 microversion: 2.1 time: 0.079637 Jun 22 17:09:24.592811 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 415/799] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-537064178 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:09:24.796873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:24.796873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:24.800914 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:24.801442 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:24.802294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:24.803054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:24.940285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:24.949893 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:24.951530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:24.954513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ee4efdee-48db-42fa-8635-356348e6aae7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.166349 Jun 22 17:09:24.955173 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 385/800] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:24 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:25.973639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:25.974991 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:25.982715 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:25.983169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:25.983954 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:25.984588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:26.216323 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:26.224648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:26.226144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:26.227300 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-45de3aad-de32-411b-95db-eee9cd8fa541 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.257779 Jun 22 17:09:26.227850 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 416/801] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:25 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:27.245577 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:27.246493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:27.253342 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:27.253798 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:27.254574 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:27.255013 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:27.389570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:27.398090 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:27.399575 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:27.400767 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2b02784c-45e3-4667-a97f-b4e9a538f4ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.159161 Jun 22 17:09:27.402473 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 386/802] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:27 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:28.419739 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:28.422489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:28.432613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:28.433117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:28.434007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:28.434342 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:28.594573 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:28.603289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:28.605030 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:28.606224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d2670734-dcea-4e5c-ae8c-9cafe81fd9e6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.191188 Jun 22 17:09:28.606775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 417/803] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:28 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:29.624868 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:29.625477 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:29.631647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:29.632097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:29.632885 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:29.633323 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:29.637372 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:29.855259 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:29.859749 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0b00f37b-4ae4-4b9b-8c90-abde7c850f0d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:29.860740 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0b00f37b-4ae4-4b9b-8c90-abde7c850f0d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:29.863995 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:29.865735 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:29.866975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4dc932c8-6a92-466d-9aa3-7a2247b310e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.246024 Jun 22 17:09:29.867695 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 387/804] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:29 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:29.871613 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0b00f37b-4ae4-4b9b-8c90-abde7c850f0d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:29.872258 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0b00f37b-4ae4-4b9b-8c90-abde7c850f0d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:29.873033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0b00f37b-4ae4-4b9b-8c90-abde7c850f0d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:29.873495 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0b00f37b-4ae4-4b9b-8c90-abde7c850f0d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:29.906539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0b00f37b-4ae4-4b9b-8c90-abde7c850f0d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050621 Jun 22 17:09:29.907468 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 418/805] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:09:29 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:29.917209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-827613d7-ebc8-4cca-8d87-f13c20541a2d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:29.917807 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-827613d7-ebc8-4cca-8d87-f13c20541a2d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:29.924644 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-827613d7-ebc8-4cca-8d87-f13c20541a2d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:29.925160 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-827613d7-ebc8-4cca-8d87-f13c20541a2d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:29.926047 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-827613d7-ebc8-4cca-8d87-f13c20541a2d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:29.926495 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-827613d7-ebc8-4cca-8d87-f13c20541a2d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:29.956454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-827613d7-ebc8-4cca-8d87-f13c20541a2d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/64c4e728-73c4-4cc4-9ae5-0befdddba622" status: 200 len: 194 microversion: 2.1 time: 0.043361 Jun 22 17:09:29.957124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 388/806] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 22 17:09:29 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/64c4e728-73c4-4cc4-9ae5-0befdddba622 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:09:30.884962 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:30.885606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:30.892002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:30.892485 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:30.893278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:30.893715 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:30.946499 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-19106edf-950c-4b01-b159-f395a978610d req-2dad0149-6da8-4fdf-a850-59bc3e117e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bb9410-a261-4625-ae42-6fe5e09a8d75", "name": "network-vif-plugged", "status": "completed", "tag": "a1e73d37-f445-4221-9965-5b010394558b"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:30.956008 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-19106edf-950c-4b01-b159-f395a978610d req-2dad0149-6da8-4fdf-a850-59bc3e117e57 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:30.956494 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-19106edf-950c-4b01-b159-f395a978610d req-2dad0149-6da8-4fdf-a850-59bc3e117e57 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:30.968123 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-19106edf-950c-4b01-b159-f395a978610d req-2dad0149-6da8-4fdf-a850-59bc3e117e57 service nova] Creating event network-vif-plugged:a1e73d37-f445-4221-9965-5b010394558b for instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 on hv-cinder-81045 Jun 22 17:09:30.973431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-19106edf-950c-4b01-b159-f395a978610d req-2dad0149-6da8-4fdf-a850-59bc3e117e57 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030943 Jun 22 17:09:30.974063 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 389/807] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:31.106166 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:31.131849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:31.134448 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:31.135092 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ad087ac4-42ad-412a-8bcb-99d19dbb055f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.253535 Jun 22 17:09:31.144269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 419/808] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:30 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:31.645136 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5c98877c-3f70-4a12-88d7-3af37199f229 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2c27a90-f2ae-487b-a652-14773268196d"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:31.646274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5c98877c-3f70-4a12-88d7-3af37199f229 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:31.652935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5c98877c-3f70-4a12-88d7-3af37199f229 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:31.653387 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5c98877c-3f70-4a12-88d7-3af37199f229 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:31.654153 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5c98877c-3f70-4a12-88d7-3af37199f229 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:31.654588 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5c98877c-3f70-4a12-88d7-3af37199f229 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:32.153756 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:32.154363 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:32.157832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:32.162064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:32.162510 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:32.163328 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:32.164025 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:32.295240 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:32.303953 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:32.305696 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:32.306872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-abc37a9b-480a-4945-9fb7-f1f52afb8bee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.157378 Jun 22 17:09:32.307939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 420/809] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:32 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:09:33.197273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5c98877c-3f70-4a12-88d7-3af37199f229 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "POST /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.556426 Jun 22 17:09:33.197881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 390/810] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:09:31 2022] POST /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments => generated 194 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:33.325751 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:33.326366 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:33.332759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:33.333205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:33.333965 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:33.334408 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:33.349667 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=100 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:33.475833 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:33.479230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:33.480789 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:33.482837 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8fcd912e-1644-441d-bb8c-7cdbb2fc1752 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.160117 Jun 22 17:09:33.482837 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 421/811] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:33 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:34.501883 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:34.502585 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:34.508838 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:34.509354 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:34.510041 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:34.510511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:34.645450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:34.654600 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:34.656095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:34.657321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e35a7d1b-8bbc-4ef3-8893-58cc524547b4 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1809 microversion: 2.20 time: 0.160208 Jun 22 17:09:34.657873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 391/812] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:34 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:35.675538 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:35.676178 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:35.682705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:35.683775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:35.684588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:35.685030 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:35.819264 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:35.827569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:35.829100 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:35.830264 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cce8b6c1-540d-4826-b67e-22ea2f9380df tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1796 microversion: 2.20 time: 0.158623 Jun 22 17:09:35.830812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 422/813] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:09:35 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:09:41.740721 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b77b9393-e8fd-43bd-a4c3-6cbc6c9a32ea tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:41.744717 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b77b9393-e8fd-43bd-a4c3-6cbc6c9a32ea tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:41.748313 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b77b9393-e8fd-43bd-a4c3-6cbc6c9a32ea tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:41.748757 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b77b9393-e8fd-43bd-a4c3-6cbc6c9a32ea tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:41.749510 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b77b9393-e8fd-43bd-a4c3-6cbc6c9a32ea tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:41.749937 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b77b9393-e8fd-43bd-a4c3-6cbc6c9a32ea tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:41.779836 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b77b9393-e8fd-43bd-a4c3-6cbc6c9a32ea tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043086 Jun 22 17:09:41.780408 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 392/814] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:09:41 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:41.919480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4103f8dd-a7a8-4c89-a00e-e1d96047b7b9 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:41.920003 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4103f8dd-a7a8-4c89-a00e-e1d96047b7b9 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:41.926527 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4103f8dd-a7a8-4c89-a00e-e1d96047b7b9 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:41.926978 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4103f8dd-a7a8-4c89-a00e-e1d96047b7b9 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:41.927772 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4103f8dd-a7a8-4c89-a00e-e1d96047b7b9 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:41.928239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4103f8dd-a7a8-4c89-a00e-e1d96047b7b9 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:41.955893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4103f8dd-a7a8-4c89-a00e-e1d96047b7b9 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/64c4e728-73c4-4cc4-9ae5-0befdddba622" status: 200 len: 194 microversion: 2.1 time: 0.040470 Jun 22 17:09:41.956491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 423/815] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 22 17:09:41 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/64c4e728-73c4-4cc4-9ae5-0befdddba622 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:41.966546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-06cf517e-def4-4b4c-bd71-96ffb60f1a5d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:41.967151 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-06cf517e-def4-4b4c-bd71-96ffb60f1a5d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:41.973107 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06cf517e-def4-4b4c-bd71-96ffb60f1a5d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:41.973533 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06cf517e-def4-4b4c-bd71-96ffb60f1a5d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:41.974285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06cf517e-def4-4b4c-bd71-96ffb60f1a5d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:41.974713 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06cf517e-def4-4b4c-bd71-96ffb60f1a5d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:42.052650 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-06cf517e-def4-4b4c-bd71-96ffb60f1a5d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lazy-loading 'services' on Instance uuid 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:09:42.230401 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-06cf517e-def4-4b4c-bd71-96ffb60f1a5d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/64c4e728-73c4-4cc4-9ae5-0befdddba622" status: 202 len: 0 microversion: 2.1 time: 0.268064 Jun 22 17:09:42.231782 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 393/816] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:09:41 2022] DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/64c4e728-73c4-4cc4-9ae5-0befdddba622 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:09:44.389143 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3b0097a7-4b71-43e1-9c84-d01d70a5b321 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:44.389639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3b0097a7-4b71-43e1-9c84-d01d70a5b321 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:44.396011 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3b0097a7-4b71-43e1-9c84-d01d70a5b321 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:44.396490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3b0097a7-4b71-43e1-9c84-d01d70a5b321 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:44.397251 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3b0097a7-4b71-43e1-9c84-d01d70a5b321 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:44.397687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3b0097a7-4b71-43e1-9c84-d01d70a5b321 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:44.426721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3b0097a7-4b71-43e1-9c84-d01d70a5b321 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/b2c27a90-f2ae-487b-a652-14773268196d" status: 200 len: 194 microversion: 2.1 time: 0.041556 Jun 22 17:09:44.427299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 424/817] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 22 17:09:44 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/b2c27a90-f2ae-487b-a652-14773268196d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:44.437503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-48f83cf2-c6b2-4fb2-ad20-0bb4cb63c92f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:44.438112 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-48f83cf2-c6b2-4fb2-ad20-0bb4cb63c92f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:44.444886 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48f83cf2-c6b2-4fb2-ad20-0bb4cb63c92f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:44.445329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48f83cf2-c6b2-4fb2-ad20-0bb4cb63c92f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:44.446075 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48f83cf2-c6b2-4fb2-ad20-0bb4cb63c92f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:44.446505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-48f83cf2-c6b2-4fb2-ad20-0bb4cb63c92f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:44.524062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-48f83cf2-c6b2-4fb2-ad20-0bb4cb63c92f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lazy-loading 'services' on Instance uuid 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:09:44.677486 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-48f83cf2-c6b2-4fb2-ad20-0bb4cb63c92f tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/b2c27a90-f2ae-487b-a652-14773268196d" status: 202 len: 0 microversion: 2.1 time: 0.244094 Jun 22 17:09:44.678059 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 394/818] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:09:44 2022] DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments/b2c27a90-f2ae-487b-a652-14773268196d => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:09:46.882978 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cc36d689-7902-4490-9ff3-4e861bc8455a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:46.883901 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-cc36d689-7902-4490-9ff3-4e861bc8455a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:46.890347 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cc36d689-7902-4490-9ff3-4e861bc8455a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:46.890787 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cc36d689-7902-4490-9ff3-4e861bc8455a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:46.891536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cc36d689-7902-4490-9ff3-4e861bc8455a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:46.891962 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cc36d689-7902-4490-9ff3-4e861bc8455a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:46.921671 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cc36d689-7902-4490-9ff3-4e861bc8455a tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042584 Jun 22 17:09:46.922197 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 425/819] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:09:46 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 17:09:47.026361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a190f8b1-c502-4557-8533-5efad37896b2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:47.026361 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a190f8b1-c502-4557-8533-5efad37896b2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:47.031329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a190f8b1-c502-4557-8533-5efad37896b2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:47.031774 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a190f8b1-c502-4557-8533-5efad37896b2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:47.032557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a190f8b1-c502-4557-8533-5efad37896b2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:47.032991 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a190f8b1-c502-4557-8533-5efad37896b2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:47.060767 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a190f8b1-c502-4557-8533-5efad37896b2 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041372 Jun 22 17:09:47.061873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 395/820] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:09:47 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 17:09:47.126938 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9c487afc-e361-407a-ad4e-ab7d44460aac tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:47.127438 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9c487afc-e361-407a-ad4e-ab7d44460aac tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:47.133689 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c487afc-e361-407a-ad4e-ab7d44460aac tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:47.134136 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c487afc-e361-407a-ad4e-ab7d44460aac tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:47.135065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c487afc-e361-407a-ad4e-ab7d44460aac tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:47.135562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9c487afc-e361-407a-ad4e-ab7d44460aac tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:47.160298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9c487afc-e361-407a-ad4e-ab7d44460aac tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:09:47.419166 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9c487afc-e361-407a-ad4e-ab7d44460aac tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 204 len: 0 microversion: 2.1 time: 0.296500 Jun 22 17:09:47.419755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 426/821] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:09:47 2022] DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:09:47.428003 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-108e8108-c6ca-434e-b2e4-8adb76b04ba6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:47.428651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-108e8108-c6ca-434e-b2e4-8adb76b04ba6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:47.434644 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-108e8108-c6ca-434e-b2e4-8adb76b04ba6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:47.435092 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-108e8108-c6ca-434e-b2e4-8adb76b04ba6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:47.436426 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-108e8108-c6ca-434e-b2e4-8adb76b04ba6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:47.436872 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-108e8108-c6ca-434e-b2e4-8adb76b04ba6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:47.569999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-108e8108-c6ca-434e-b2e4-8adb76b04ba6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:47.578003 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-108e8108-c6ca-434e-b2e4-8adb76b04ba6 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1672 microversion: 2.1 time: 0.153872 Jun 22 17:09:47.578561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 396/822] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:47 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:09:48.595269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d6d87d38-9d79-48ec-b9fe-8f872037feba tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:48.595967 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d6d87d38-9d79-48ec-b9fe-8f872037feba tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:48.602375 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d6d87d38-9d79-48ec-b9fe-8f872037feba tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:48.602819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d6d87d38-9d79-48ec-b9fe-8f872037feba tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:48.603569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d6d87d38-9d79-48ec-b9fe-8f872037feba tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:48.603998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d6d87d38-9d79-48ec-b9fe-8f872037feba tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:48.731648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d6d87d38-9d79-48ec-b9fe-8f872037feba tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:48.739894 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d6d87d38-9d79-48ec-b9fe-8f872037feba tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1672 microversion: 2.1 time: 0.148871 Jun 22 17:09:48.740505 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 427/823] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:48 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:09:49.756687 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4e61ddef-0714-48a1-9c47-fe38b044ccf3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:49.757297 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4e61ddef-0714-48a1-9c47-fe38b044ccf3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:49.763675 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e61ddef-0714-48a1-9c47-fe38b044ccf3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:49.764153 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e61ddef-0714-48a1-9c47-fe38b044ccf3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:49.764926 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e61ddef-0714-48a1-9c47-fe38b044ccf3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:49.765359 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e61ddef-0714-48a1-9c47-fe38b044ccf3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:50.047806 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4e61ddef-0714-48a1-9c47-fe38b044ccf3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:50.055376 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4e61ddef-0714-48a1-9c47-fe38b044ccf3 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1672 microversion: 2.1 time: 0.302484 Jun 22 17:09:50.056034 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 397/824] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:49 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1672 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:09:50.553676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-0f955f46-484b-4608-9275-9980c9c43587 req-74db9062-3d4f-484d-85cb-a93f12f54caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2c8aa6-43e1-43e3-9f31-4db4e63119c8", "name": "network-vif-deleted", "tag": "12723d2a-5bc4-4712-9930-f22e6977da14"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:09:50.563316 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-0f955f46-484b-4608-9275-9980c9c43587 req-74db9062-3d4f-484d-85cb-a93f12f54caf service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:50.565570 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-0f955f46-484b-4608-9275-9980c9c43587 req-74db9062-3d4f-484d-85cb-a93f12f54caf service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:50.574745 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-0f955f46-484b-4608-9275-9980c9c43587 req-74db9062-3d4f-484d-85cb-a93f12f54caf service nova] Creating event network-vif-deleted:12723d2a-5bc4-4712-9930-f22e6977da14 for instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 on hv-cinder-81045 Jun 22 17:09:50.580258 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-0f955f46-484b-4608-9275-9980c9c43587 req-74db9062-3d4f-484d-85cb-a93f12f54caf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030314 Jun 22 17:09:50.580848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 428/825] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:09:51.073054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:51.073664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:51.076402 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=35 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:51.081150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:51.081595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:51.082534 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:51.082970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:51.114640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:51.115088 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:51.115534 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lazy-loading 'fault' on Instance uuid 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:09:51.155676 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c35fb18d4f44f26a6a0939503da0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd096da8704dd3bc211b07e7f1f27e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:09:51.163048 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-31287163-bed4-4de8-8dae-f41e1b86e3d0 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 200 len: 1327 microversion: 2.1 time: 0.094226 Jun 22 17:09:51.163631 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 398/826] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:51 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:09:52.182185 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:52.182919 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:52.189272 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:52.189721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:52.190474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:52.190905 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:52.204256 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] HTTP exception thrown: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Request method failure captured: Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 HTTP/1.1 Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0rJf0J-OdOYNI4ZR5TNyByK9Hi5-TPMDaoaelt8WoFw-S2K_WNOAyBN7Ah90pq-pzezt8uY2Mor-rF8pntD34FjTz2lg3cNFIvW6_Sc5jNB_u1HCQPtIDv_kaZTEz6vzF2-q_2s6wB-oaBK84KTA-q55JqukQmGtZy-w7tju44sBKI Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:09:52.205860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 7c35fb18d4f44f26a6a0939503da0b0e Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:52.207529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '0d2c8aa6-43e1-43e3-9f31-4db4e63119c8'} Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:09:52.208507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:52.210036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:52.211659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Returning 404 to user: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:09:52.211659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6392f366-ebaf-4325-8ae0-301d37144315 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 404 len: 111 microversion: 2.1 time: 0.029829 Jun 22 17:09:52.211659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 429/827] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:52 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:09:52.215805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-33cd543d-ace1-4aa0-8939-a1e5706cb130 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '.version_select at 0x7fe0a0428550>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:52.319397 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-33cd543d-ace1-4aa0-8939-a1e5706cb130 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014570224" status: 202 len: 0 microversion: 2.1 time: 0.107162 Jun 22 17:09:52.319917 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 399/828] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 22 17:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014570224 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:09:55.528239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:55.528744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:55.536758 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:55.537209 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:55.537983 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:55.538429 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:55.552737 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] HTTP exception thrown: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Request method failure captured: Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 HTTP/1.1 Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0rJf0J-OdOYNI4ZR5TNyByK9Hi5-TPMDaoaelt8WoFw-S2K_WNOAyBN7Ah90pq-pzezt8uY2Mor-rF8pntD34FjTz2lg3cNFIvW6_Sc5jNB_u1HCQPtIDv_kaZTEz6vzF2-q_2s6wB-oaBK84KTA-q55JqukQmGtZy-w7tju44sBKI Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:09:55.554298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 7c35fb18d4f44f26a6a0939503da0b0e Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.555916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '0d2c8aa6-43e1-43e3-9f31-4db4e63119c8'} Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:09:55.556832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.558094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.559333 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Returning 404 to user: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:09:55.559333 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8f3e9e8b-625f-4922-805e-41cf8d583f86 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 404 len: 111 microversion: 2.1 time: 0.031806 Jun 22 17:09:55.559333 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 430/829] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:09:55 2022] DELETE /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:09:55.565049 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:55.565668 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:55.571657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:55.572129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:55.572913 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:55.573352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:55.586614 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] HTTP exception thrown: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Request method failure captured: Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 HTTP/1.1 Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0rJf0J-OdOYNI4ZR5TNyByK9Hi5-TPMDaoaelt8WoFw-S2K_WNOAyBN7Ah90pq-pzezt8uY2Mor-rF8pntD34FjTz2lg3cNFIvW6_Sc5jNB_u1HCQPtIDv_kaZTEz6vzF2-q_2s6wB-oaBK84KTA-q55JqukQmGtZy-w7tju44sBKI Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:09:55.588281 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 7c35fb18d4f44f26a6a0939503da0b0e Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.589845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '0d2c8aa6-43e1-43e3-9f31-4db4e63119c8'} Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:09:55.590647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. Jun 22 17:09:55.591944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:55.593881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Returning 404 to user: Instance 0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:09:55.593881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b48ae8f7-1a59-461c-b07a-183e12443201 tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8" status: 404 len: 111 microversion: 2.1 time: 0.028908 Jun 22 17:09:55.593881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 400/830] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:55 2022] GET /compute/v2.1/servers/0d2c8aa6-43e1-43e3-9f31-4db4e63119c8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:09:57.029259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:57.029755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:57.036274 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:57.036719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:57.037478 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:57.038036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:57.051325 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] HTTP exception thrown: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Request method failure captured: Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: DELETE /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 HTTP/1.1 Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0rJf0J-OdOYNI4ZR5TNyByK9Hi5-TPMDaoaelt8WoFw-S2K_WNOAyBN7Ah90pq-pzezt8uY2Mor-rF8pntD34FjTz2lg3cNFIvW6_Sc5jNB_u1HCQPtIDv_kaZTEz6vzF2-q_2s6wB-oaBK84KTA-q55JqukQmGtZy-w7tju44sBKI Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:09:57.052896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 7c35fb18d4f44f26a6a0939503da0b0e Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.054332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '5168389e-f141-4e31-9c66-a365b612cd02'} Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:09:57.055065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.056469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.058084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Returning 404 to user: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:09:57.058084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-80657126-7ff4-4911-a37b-9b4db4182eda tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 404 len: 111 microversion: 2.1 time: 0.028842 Jun 22 17:09:57.058084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 431/831] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:09:57 2022] DELETE /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:09:57.063325 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:09:57.063939 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] [instance: 5168389e-f141-4e31-9c66-a365b612cd02] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:09:57.070332 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:57.070779 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:57.071545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:09:57.071979 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:09:57.085576 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] HTTP exception thrown: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Request method failure captured: Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 HTTP/1.1 Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0rJf0J-OdOYNI4ZR5TNyByK9Hi5-TPMDaoaelt8WoFw-S2K_WNOAyBN7Ah90pq-pzezt8uY2Mor-rF8pntD34FjTz2lg3cNFIvW6_Sc5jNB_u1HCQPtIDv_kaZTEz6vzF2-q_2s6wB-oaBK84KTA-q55JqukQmGtZy-w7tju44sBKI Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:09:57.087097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0cdd096da8704dd3bc211b07e7f1f27e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 0cdd096da8704dd3bc211b07e7f1f27e Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267544219 Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 7c35fb18d4f44f26a6a0939503da0b0e Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeTestJSON-1267544219-project Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.088826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '5168389e-f141-4e31-9c66-a365b612cd02'} Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:09:57.089737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. Jun 22 17:09:57.090945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:09:57.091998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] Returning 404 to user: Instance 5168389e-f141-4e31-9c66-a365b612cd02 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:09:57.091998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-49b98071-c6a4-4c50-b238-70f1c808254d tempest-AttachVolumeTestJSON-1267544219 tempest-AttachVolumeTestJSON-1267544219-project] 10.222.0.18 "GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02" status: 404 len: 111 microversion: 2.1 time: 0.029943 Jun 22 17:09:57.091998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 401/832] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:09:57 2022] GET /compute/v2.1/servers/5168389e-f141-4e31-9c66-a365b612cd02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:10:07.973108 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:07.973855 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:08.103173 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d1a0a793-439a-4cea-b43a-6a54010149b3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: .version_select at 0x7fe0a02fcaf0>, body: {"keypair": {"name": "tempest-keypair-828009364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAhEsxkkIwB14tPAJ9AcOKmohEQT/yRlDYprqgG1wo1AfhANmZxtrgvfvuWa1VR6tFd9aCgSgkdDKyNZsldRheyDVbzA5mH3abmBztfOldvqd6tj2ba7/+eN1DslQ8CRw=="}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:08.118164 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-d1a0a793-439a-4cea-b43a-6a54010149b3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for project 069840ebd26e434c861568668776df52. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:10:08.121975 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-d1a0a793-439a-4cea-b43a-6a54010149b3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for user 05951aa9ba2344a994f9fa1aa6fdb3bf and project 069840ebd26e434c861568668776df52. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:10:08.211341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d1a0a793-439a-4cea-b43a-6a54010149b3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.243143 Jun 22 17:10:08.211939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 432/833] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:10:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:10:10.398651 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-684786389", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62ce7501-df82-41e9-98c8-d1402b2e1e32"}], "security_groups": [{"name": "tempest-securitygroup--1619019368"}], "key_name": "tempest-keypair-828009364", "user_data": "}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:10.405819 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:10.406520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:10.509965 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] validate_networks() for [('62ce7501-df82-41e9-98c8-d1402b2e1e32', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:10:10.959493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:10:10.960324 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:10:10.960802 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:10:10.962138 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:10:10.962561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:10:10.972220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:10.972887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:10.973937 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:10.974562 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:10.992362 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for project 069840ebd26e434c861568668776df52. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:10:10.996487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for user 05951aa9ba2344a994f9fa1aa6fdb3bf and project 069840ebd26e434c861568668776df52. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:10:11.008382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:10:11.011017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:10:11.163677 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3580a1e2-f22f-48e5-b14e-bcec1bbfef13 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.769174 Jun 22 17:10:11.171380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 402/834] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:10:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:10:11.180377 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b8594650-244b-4512-be34-d424d766bceb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:11.181474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b8594650-244b-4512-be34-d424d766bceb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:11.245119 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b8594650-244b-4512-be34-d424d766bceb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:11.252401 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b8594650-244b-4512-be34-d424d766bceb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1240 microversion: 2.1 time: 0.079191 Jun 22 17:10:11.252971 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 433/835] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:11 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:10:12.271924 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-51e47914-bd56-42ff-b3c3-72adb3193db9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:12.272686 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-51e47914-bd56-42ff-b3c3-72adb3193db9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:12.326098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-51e47914-bd56-42ff-b3c3-72adb3193db9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:12.333293 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-51e47914-bd56-42ff-b3c3-72adb3193db9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1240 microversion: 2.1 time: 0.065829 Jun 22 17:10:12.333853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 403/836] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:12 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:13.352694 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8b86be12-480f-4fcb-a26d-67319305eb5f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:13.358491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8b86be12-480f-4fcb-a26d-67319305eb5f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:13.405338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-8b86be12-480f-4fcb-a26d-67319305eb5f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:13.411932 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8b86be12-480f-4fcb-a26d-67319305eb5f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1240 microversion: 2.1 time: 0.063095 Jun 22 17:10:13.412760 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 434/837] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:13 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1240 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:14.429245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-40fe9718-091b-42f0-9add-4342addc7187 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:14.429848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-40fe9718-091b-42f0-9add-4342addc7187 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:14.481094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-40fe9718-091b-42f0-9add-4342addc7187 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:14.488291 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-40fe9718-091b-42f0-9add-4342addc7187 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1240 microversion: 2.1 time: 0.062761 Jun 22 17:10:14.488837 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 404/838] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:14 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1240 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:15.508456 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a5155155-5bfd-4808-8f0d-66b628102a5e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:15.509095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a5155155-5bfd-4808-8f0d-66b628102a5e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:15.516272 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5155155-5bfd-4808-8f0d-66b628102a5e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:15.516729 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5155155-5bfd-4808-8f0d-66b628102a5e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:15.517493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5155155-5bfd-4808-8f0d-66b628102a5e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:15.517931 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5155155-5bfd-4808-8f0d-66b628102a5e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:15.576653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a5155155-5bfd-4808-8f0d-66b628102a5e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:15.583872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a5155155-5bfd-4808-8f0d-66b628102a5e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1244 microversion: 2.1 time: 0.079359 Jun 22 17:10:15.584464 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 435/839] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:15 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:16.599602 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-80cbd044-4ef9-4467-91df-8dc1fd80b49c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:16.600277 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-80cbd044-4ef9-4467-91df-8dc1fd80b49c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:16.607184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-80cbd044-4ef9-4467-91df-8dc1fd80b49c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:16.608326 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-80cbd044-4ef9-4467-91df-8dc1fd80b49c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:16.608443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-80cbd044-4ef9-4467-91df-8dc1fd80b49c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:16.608843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-80cbd044-4ef9-4467-91df-8dc1fd80b49c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:16.668343 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-80cbd044-4ef9-4467-91df-8dc1fd80b49c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:16.675604 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-80cbd044-4ef9-4467-91df-8dc1fd80b49c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1244 microversion: 2.1 time: 0.079927 Jun 22 17:10:16.676191 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 405/840] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:16 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:17.692842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fef94d44-9fca-4070-990a-28292742f733 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:17.693452 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fef94d44-9fca-4070-990a-28292742f733 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:17.700295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fef94d44-9fca-4070-990a-28292742f733 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:17.702088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fef94d44-9fca-4070-990a-28292742f733 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:17.702088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fef94d44-9fca-4070-990a-28292742f733 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:17.702088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fef94d44-9fca-4070-990a-28292742f733 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:17.768716 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fef94d44-9fca-4070-990a-28292742f733 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:17.776753 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fef94d44-9fca-4070-990a-28292742f733 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1300 microversion: 2.1 time: 0.088343 Jun 22 17:10:17.777639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 436/841] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:17 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:18.794811 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0f032817-5ca2-4adc-b4f9-181d057ad50d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:18.795426 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0f032817-5ca2-4adc-b4f9-181d057ad50d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:18.802483 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0f032817-5ca2-4adc-b4f9-181d057ad50d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:18.802926 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0f032817-5ca2-4adc-b4f9-181d057ad50d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:18.803709 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0f032817-5ca2-4adc-b4f9-181d057ad50d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:18.804172 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0f032817-5ca2-4adc-b4f9-181d057ad50d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:19.033136 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0f032817-5ca2-4adc-b4f9-181d057ad50d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:19.043988 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0f032817-5ca2-4adc-b4f9-181d057ad50d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1366 microversion: 2.1 time: 0.253211 Jun 22 17:10:19.044894 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 406/842] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:18 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:19.306651 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-927e44a0-bd8d-4c01-b97b-8bb734e81e48 req-3cbe88d6-506d-4966-b164-9e04e269f90c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb371f6-ae21-429b-a7e4-d43500167025", "tag": "f3ff402f-3af5-42df-8ae8-00f340bfd75d"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:19.315202 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-927e44a0-bd8d-4c01-b97b-8bb734e81e48 req-3cbe88d6-506d-4966-b164-9e04e269f90c service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:19.320569 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-927e44a0-bd8d-4c01-b97b-8bb734e81e48 req-3cbe88d6-506d-4966-b164-9e04e269f90c service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:19.331297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-927e44a0-bd8d-4c01-b97b-8bb734e81e48 req-3cbe88d6-506d-4966-b164-9e04e269f90c service nova] Creating event network-changed:f3ff402f-3af5-42df-8ae8-00f340bfd75d for instance fcb371f6-ae21-429b-a7e4-d43500167025 on hv-cinder-81045 Jun 22 17:10:19.337337 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-927e44a0-bd8d-4c01-b97b-8bb734e81e48 req-3cbe88d6-506d-4966-b164-9e04e269f90c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092287 Jun 22 17:10:19.339002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 437/843] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:10:20.065688 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-932bd753-bd5f-4b98-8a0d-1c83239db05b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:20.066363 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-932bd753-bd5f-4b98-8a0d-1c83239db05b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:20.072694 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-932bd753-bd5f-4b98-8a0d-1c83239db05b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:20.073144 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-932bd753-bd5f-4b98-8a0d-1c83239db05b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:20.073899 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-932bd753-bd5f-4b98-8a0d-1c83239db05b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:20.074330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-932bd753-bd5f-4b98-8a0d-1c83239db05b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:20.202204 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-932bd753-bd5f-4b98-8a0d-1c83239db05b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:20.209516 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-932bd753-bd5f-4b98-8a0d-1c83239db05b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1366 microversion: 2.1 time: 0.148318 Jun 22 17:10:20.210076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 407/844] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:20 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:21.226470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-99986813-8636-4570-b8d9-48a7e65c3929 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:21.227180 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-99986813-8636-4570-b8d9-48a7e65c3929 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:21.233803 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99986813-8636-4570-b8d9-48a7e65c3929 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:21.234249 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99986813-8636-4570-b8d9-48a7e65c3929 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:21.235030 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99986813-8636-4570-b8d9-48a7e65c3929 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:21.235463 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-99986813-8636-4570-b8d9-48a7e65c3929 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:21.364995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-99986813-8636-4570-b8d9-48a7e65c3929 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:21.372609 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-99986813-8636-4570-b8d9-48a7e65c3929 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1366 microversion: 2.1 time: 0.150284 Jun 22 17:10:21.373165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 438/845] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:21 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:22.390096 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-970db32b-47bc-4713-9040-4a4e3f39db17 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:22.390664 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-970db32b-47bc-4713-9040-4a4e3f39db17 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:22.392495 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:22.398004 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-970db32b-47bc-4713-9040-4a4e3f39db17 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:22.403294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-970db32b-47bc-4713-9040-4a4e3f39db17 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:22.403294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-970db32b-47bc-4713-9040-4a4e3f39db17 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:22.403294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-970db32b-47bc-4713-9040-4a4e3f39db17 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:22.531691 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-970db32b-47bc-4713-9040-4a4e3f39db17 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:22.539765 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-970db32b-47bc-4713-9040-4a4e3f39db17 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1366 microversion: 2.1 time: 0.153367 Jun 22 17:10:22.540369 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 408/846] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:22 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:23.557269 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cd1cadbe-d99e-4a7e-9032-d4ded3e35181 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:23.557853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-cd1cadbe-d99e-4a7e-9032-d4ded3e35181 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:23.560281 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=8 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:23.565089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cd1cadbe-d99e-4a7e-9032-d4ded3e35181 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:23.565530 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cd1cadbe-d99e-4a7e-9032-d4ded3e35181 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:23.566287 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cd1cadbe-d99e-4a7e-9032-d4ded3e35181 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:23.566715 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cd1cadbe-d99e-4a7e-9032-d4ded3e35181 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:23.696378 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cd1cadbe-d99e-4a7e-9032-d4ded3e35181 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:23.704522 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cd1cadbe-d99e-4a7e-9032-d4ded3e35181 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1366 microversion: 2.1 time: 0.151310 Jun 22 17:10:23.709639 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 439/847] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:23 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:24.721869 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d8303ac7-80a2-4398-a731-115c671cb4fb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:24.723010 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d8303ac7-80a2-4398-a731-115c671cb4fb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:24.724940 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=10 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:24.729702 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d8303ac7-80a2-4398-a731-115c671cb4fb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:24.730139 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d8303ac7-80a2-4398-a731-115c671cb4fb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:24.730888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d8303ac7-80a2-4398-a731-115c671cb4fb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:24.731318 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d8303ac7-80a2-4398-a731-115c671cb4fb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:24.858740 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d8303ac7-80a2-4398-a731-115c671cb4fb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:24.866703 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d8303ac7-80a2-4398-a731-115c671cb4fb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1366 microversion: 2.1 time: 0.148690 Jun 22 17:10:24.871768 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 409/848] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:24 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:25.234932 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-e3f87271-a4f2-45ca-9e01-50d5441bf167 req-43360853-aecc-40f2-a05d-dd2eb8b3b996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb371f6-ae21-429b-a7e4-d43500167025", "name": "network-vif-plugged", "status": "completed", "tag": "f3ff402f-3af5-42df-8ae8-00f340bfd75d"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:25.243332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-e3f87271-a4f2-45ca-9e01-50d5441bf167 req-43360853-aecc-40f2-a05d-dd2eb8b3b996 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:25.246271 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-e3f87271-a4f2-45ca-9e01-50d5441bf167 req-43360853-aecc-40f2-a05d-dd2eb8b3b996 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:25.255047 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-e3f87271-a4f2-45ca-9e01-50d5441bf167 req-43360853-aecc-40f2-a05d-dd2eb8b3b996 service nova] Creating event network-vif-plugged:f3ff402f-3af5-42df-8ae8-00f340bfd75d for instance fcb371f6-ae21-429b-a7e4-d43500167025 on hv-cinder-81045 Jun 22 17:10:25.260339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-e3f87271-a4f2-45ca-9e01-50d5441bf167 req-43360853-aecc-40f2-a05d-dd2eb8b3b996 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029719 Jun 22 17:10:25.261040 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 440/849] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:10:25.884444 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-759c6cf8-81ed-4a48-8051-20db396e3b7b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:25.885264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-759c6cf8-81ed-4a48-8051-20db396e3b7b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:25.891325 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-759c6cf8-81ed-4a48-8051-20db396e3b7b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:25.892028 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-759c6cf8-81ed-4a48-8051-20db396e3b7b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:25.892569 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-759c6cf8-81ed-4a48-8051-20db396e3b7b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:25.893005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-759c6cf8-81ed-4a48-8051-20db396e3b7b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:26.021864 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-759c6cf8-81ed-4a48-8051-20db396e3b7b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:26.029169 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-759c6cf8-81ed-4a48-8051-20db396e3b7b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1366 microversion: 2.1 time: 0.148747 Jun 22 17:10:26.029710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 410/850] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:25 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:27.046669 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b17220bc-b8c8-47ff-8eb1-9fbfe7ac3b00 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:27.047343 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b17220bc-b8c8-47ff-8eb1-9fbfe7ac3b00 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:27.054307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b17220bc-b8c8-47ff-8eb1-9fbfe7ac3b00 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:27.054756 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b17220bc-b8c8-47ff-8eb1-9fbfe7ac3b00 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:27.055511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b17220bc-b8c8-47ff-8eb1-9fbfe7ac3b00 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:27.055946 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b17220bc-b8c8-47ff-8eb1-9fbfe7ac3b00 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:27.183967 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b17220bc-b8c8-47ff-8eb1-9fbfe7ac3b00 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:27.191402 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b17220bc-b8c8-47ff-8eb1-9fbfe7ac3b00 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1366 microversion: 2.1 time: 0.149491 Jun 22 17:10:27.191955 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 441/851] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:27 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:28.208749 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e8b3d51a-c3a0-4a59-81e7-3de00676bbf6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:28.209253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e8b3d51a-c3a0-4a59-81e7-3de00676bbf6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:28.215566 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8b3d51a-c3a0-4a59-81e7-3de00676bbf6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:28.216010 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8b3d51a-c3a0-4a59-81e7-3de00676bbf6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:28.216818 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8b3d51a-c3a0-4a59-81e7-3de00676bbf6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:28.217249 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8b3d51a-c3a0-4a59-81e7-3de00676bbf6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:28.342472 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e8b3d51a-c3a0-4a59-81e7-3de00676bbf6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:28.350190 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e8b3d51a-c3a0-4a59-81e7-3de00676bbf6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1556 microversion: 2.1 time: 0.145893 Jun 22 17:10:28.350753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 411/852] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:10:28 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:28.366872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fef4dfc6-8c4f-4008-9986-4064c47774e1 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:28.367364 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fef4dfc6-8c4f-4008-9986-4064c47774e1 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:28.373822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fef4dfc6-8c4f-4008-9986-4064c47774e1 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:28.374266 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fef4dfc6-8c4f-4008-9986-4064c47774e1 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:28.375024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fef4dfc6-8c4f-4008-9986-4064c47774e1 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:28.375460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fef4dfc6-8c4f-4008-9986-4064c47774e1 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:28.449410 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fef4dfc6-8c4f-4008-9986-4064c47774e1 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086983 Jun 22 17:10:28.450000 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 442/853] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 17:10:28 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:10:29.714203 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-bdf81636-a9cd-45e4-9a20-e06bba5af554 req-8913ec3d-ee7c-404c-ba58-29f60c2a5fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb371f6-ae21-429b-a7e4-d43500167025", "tag": "f3ff402f-3af5-42df-8ae8-00f340bfd75d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:29.722621 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-bdf81636-a9cd-45e4-9a20-e06bba5af554 req-8913ec3d-ee7c-404c-ba58-29f60c2a5fb3 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:29.723063 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-bdf81636-a9cd-45e4-9a20-e06bba5af554 req-8913ec3d-ee7c-404c-ba58-29f60c2a5fb3 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:29.734026 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-bdf81636-a9cd-45e4-9a20-e06bba5af554 req-8913ec3d-ee7c-404c-ba58-29f60c2a5fb3 service nova] Creating event network-changed:f3ff402f-3af5-42df-8ae8-00f340bfd75d for instance fcb371f6-ae21-429b-a7e4-d43500167025 on hv-cinder-81045 Jun 22 17:10:29.740187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-bdf81636-a9cd-45e4-9a20-e06bba5af554 req-8913ec3d-ee7c-404c-ba58-29f60c2a5fb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089880 Jun 22 17:10:29.741189 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 412/854] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:10:31.162497 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a23bb205-c14d-493c-b4ca-9a1d205cc514 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:31.163003 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a23bb205-c14d-493c-b4ca-9a1d205cc514 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:31.169367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a23bb205-c14d-493c-b4ca-9a1d205cc514 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:31.169819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a23bb205-c14d-493c-b4ca-9a1d205cc514 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:31.170583 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a23bb205-c14d-493c-b4ca-9a1d205cc514 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:31.171050 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a23bb205-c14d-493c-b4ca-9a1d205cc514 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:31.199491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a23bb205-c14d-493c-b4ca-9a1d205cc514 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments/dae5b23a-9441-463e-bb3c-1be5cecbd70d" status: 200 len: 194 microversion: 2.20 time: 0.041700 Jun 22 17:10:31.200059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 443/855] 10.222.0.18 () {60 vars in 1453 bytes} [Wed Jun 22 17:10:31 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments/dae5b23a-9441-463e-bb3c-1be5cecbd70d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 17:10:31.262110 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-206f0a02-5500-4ee4-90c4-679f095f216c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:31.262871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-206f0a02-5500-4ee4-90c4-679f095f216c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:31.269455 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-206f0a02-5500-4ee4-90c4-679f095f216c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:31.269897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-206f0a02-5500-4ee4-90c4-679f095f216c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:31.270646 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-206f0a02-5500-4ee4-90c4-679f095f216c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:31.271074 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-206f0a02-5500-4ee4-90c4-679f095f216c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:31.351433 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-206f0a02-5500-4ee4-90c4-679f095f216c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lazy-loading 'services' on Instance uuid 78bb9410-a261-4625-ae42-6fe5e09a8d75 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:10:31.583671 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-206f0a02-5500-4ee4-90c4-679f095f216c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "DELETE /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments/dae5b23a-9441-463e-bb3c-1be5cecbd70d" status: 202 len: 0 microversion: 2.20 time: 0.325578 Jun 22 17:10:31.584594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 413/856] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Jun 22 17:10:31 2022] DELETE /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments/dae5b23a-9441-463e-bb3c-1be5cecbd70d => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 22 17:10:31.593025 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a949a5f2-6c90-4954-940e-57ab2a67e9c5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:31.593945 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a949a5f2-6c90-4954-940e-57ab2a67e9c5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:31.600406 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a949a5f2-6c90-4954-940e-57ab2a67e9c5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:31.600848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a949a5f2-6c90-4954-940e-57ab2a67e9c5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:31.601610 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a949a5f2-6c90-4954-940e-57ab2a67e9c5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:31.602038 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a949a5f2-6c90-4954-940e-57ab2a67e9c5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:31.633767 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a949a5f2-6c90-4954-940e-57ab2a67e9c5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044784 Jun 22 17:10:31.634308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 444/857] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 22 17:10:31 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 17:10:32.646459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7b2d7bd3-f3a4-4eec-8311-cb0632d13e2e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:32.647511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7b2d7bd3-f3a4-4eec-8311-cb0632d13e2e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:32.654759 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b2d7bd3-f3a4-4eec-8311-cb0632d13e2e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:32.655202 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b2d7bd3-f3a4-4eec-8311-cb0632d13e2e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:32.655963 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b2d7bd3-f3a4-4eec-8311-cb0632d13e2e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:32.656420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b2d7bd3-f3a4-4eec-8311-cb0632d13e2e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:32.687604 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7b2d7bd3-f3a4-4eec-8311-cb0632d13e2e tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045738 Jun 22 17:10:32.688172 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 414/858] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 22 17:10:32 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 17:10:33.699265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-91c6e9cc-d58f-4e07-99b3-bc2da1d14d95 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:33.700430 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-91c6e9cc-d58f-4e07-99b3-bc2da1d14d95 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:33.706885 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-91c6e9cc-d58f-4e07-99b3-bc2da1d14d95 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:33.707329 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-91c6e9cc-d58f-4e07-99b3-bc2da1d14d95 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:33.708256 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-91c6e9cc-d58f-4e07-99b3-bc2da1d14d95 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:33.708689 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-91c6e9cc-d58f-4e07-99b3-bc2da1d14d95 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:33.736789 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-91c6e9cc-d58f-4e07-99b3-bc2da1d14d95 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041509 Jun 22 17:10:33.737344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 445/859] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 22 17:10:33 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:10:33.794304 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9159cac8-77f3-4a0b-a9f4-e34714f1d760 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:33.794815 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9159cac8-77f3-4a0b-a9f4-e34714f1d760 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:33.801838 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9159cac8-77f3-4a0b-a9f4-e34714f1d760 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:33.802277 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9159cac8-77f3-4a0b-a9f4-e34714f1d760 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:33.803025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9159cac8-77f3-4a0b-a9f4-e34714f1d760 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:33.803462 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9159cac8-77f3-4a0b-a9f4-e34714f1d760 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:33.827688 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9159cac8-77f3-4a0b-a9f4-e34714f1d760 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:10:34.083877 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9159cac8-77f3-4a0b-a9f4-e34714f1d760 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "DELETE /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 204 len: 0 microversion: 2.20 time: 0.293165 Jun 22 17:10:34.084487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 415/860] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 22 17:10:33 2022] DELETE /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 22 17:10:34.092617 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:34.099010 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:34.099798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:34.100281 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:34.101085 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:34.101517 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:34.232369 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:34.240330 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:34.242825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:34.243987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-924925f0-a55e-442c-9ab0-cd0fac3eafe6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.155304 Jun 22 17:10:34.244562 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 446/861] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:34 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:35.262420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:35.263109 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:35.269559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:35.270001 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:35.270752 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:35.271180 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:35.402941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:35.411688 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:35.413202 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:35.414349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3a555197-305e-401b-b606-2af6226df2f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.156227 Jun 22 17:10:35.415146 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 416/862] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:35 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:36.433033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:36.433642 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:36.440162 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:36.440711 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:36.441983 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:36.442418 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:36.569608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:36.577462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:36.578947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:36.580086 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-deaa619f-a8d9-408e-a76f-6423ee1ba920 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1724 microversion: 2.20 time: 0.151034 Jun 22 17:10:36.580803 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 447/863] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:36 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:36.901653 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-fe4c0ae7-c40f-45a2-8b1b-f0edafaa7b8a req-470b6859-31dc-472c-8ec7-593a37571ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bb9410-a261-4625-ae42-6fe5e09a8d75", "name": "network-vif-deleted", "tag": "a1e73d37-f445-4221-9965-5b010394558b"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:36.908880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fe4c0ae7-c40f-45a2-8b1b-f0edafaa7b8a req-470b6859-31dc-472c-8ec7-593a37571ea8 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:36.909311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fe4c0ae7-c40f-45a2-8b1b-f0edafaa7b8a req-470b6859-31dc-472c-8ec7-593a37571ea8 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:36.921435 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-fe4c0ae7-c40f-45a2-8b1b-f0edafaa7b8a req-470b6859-31dc-472c-8ec7-593a37571ea8 service nova] Creating event network-vif-deleted:a1e73d37-f445-4221-9965-5b010394558b for instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 on hv-cinder-81045 Jun 22 17:10:36.926873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-fe4c0ae7-c40f-45a2-8b1b-f0edafaa7b8a req-470b6859-31dc-472c-8ec7-593a37571ea8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030859 Jun 22 17:10:36.927747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 417/864] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:10:37.598379 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:37.598998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:37.606233 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:37.609242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:37.609242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:37.609242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:37.640296 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:37.640751 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:37.641210 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lazy-loading 'fault' on Instance uuid 78bb9410-a261-4625-ae42-6fe5e09a8d75 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:10:37.687264 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:37.696367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:37.697939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:37.699105 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-baa6f414-8189-4440-8b1f-b1ee1d9168a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 200 len: 1371 microversion: 2.20 time: 0.104740 Jun 22 17:10:37.699707 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 448/865] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:37 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:38.719086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:38.719923 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:38.726880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:38.727327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:38.728089 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:38.728547 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:38.741295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] HTTP exception thrown: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Request method failure captured: Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 HTTP/1.1 Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0wpokYbKaw-VU9G_-JdSOJQi3yVnOGqUn-K0c7gU0mixeNcJcHfJOH_Rx55rlQ4cL_dkS-8bLZO_YKcvMeSuYN2D9Ka_Wn-swZ1e0EMeBudmcP85IznUhRogPF9M-WEPLk29cRT0HiN0_oSKo24gMr38ImFjV2pR2xXEUONSLhohh4 Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:10:38.742891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: afd423384efd459babccf3ff34214973 Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:10:38.744638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '78bb9410-a261-4625-ae42-6fe5e09a8d75'} Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:10:38.745615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:10:38.747266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:10:38.748775 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Returning 404 to user: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:10:38.748775 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-21a76eb2-a7b3-4bfb-8a5d-886e8b0a4b06 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 404 len: 111 microversion: 2.20 time: 0.030028 Jun 22 17:10:38.748775 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 418/866] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:38 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 17:10:38.753073 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5f089345-ccc3-482b-9b8e-5a3336c5f8ca tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '.version_select at 0x7fe0a0e3e550>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:38.826812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5f089345-ccc3-482b-9b8e-5a3336c5f8ca tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279481326" status: 204 len: 0 microversion: 2.20 time: 0.077511 Jun 22 17:10:38.827377 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 449/867] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Jun 22 17:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279481326 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 22 17:10:39.548785 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b3e53340-8adf-4ccf-abcd-953774cdc5e2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'create', calling method: .version_select at 0x7fe0a03d4040>, body: {"keypair": {"name": "tempest-keypair-337968557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6RXdOSa/XNVzdSNnOLHLQ/hsySEbhLQy0NGmMLJJNlH/zL50JaOYI50+iNtBCfswHFZgKogxhklKTIDjPl7L4OVEapOPsoIPBHRUjM5TYlr/snAxUm2ENF6fHJw5bG+w=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:39.562524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-b3e53340-8adf-4ccf-abcd-953774cdc5e2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Getting quotas for project 8d5f63bad73c4a89b604c29290e4143f. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:10:39.566793 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-b3e53340-8adf-4ccf-abcd-953774cdc5e2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Getting quotas for user afd423384efd459babccf3ff34214973 and project 8d5f63bad73c4a89b604c29290e4143f. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:10:39.638573 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b3e53340-8adf-4ccf-abcd-953774cdc5e2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.093701 Jun 22 17:10:39.639148 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 419/868] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Jun 22 17:10:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 17:10:40.047597 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:10:40.048098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:10:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:10:41.778289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1978693159", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3453d2d-2b7e-4051-9b69-5a0492d7260a"}], "security_groups": [{"name": "tempest-securitygroup--290908772"}], "key_name": "tempest-keypair-337968557", "user_data": "}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:41.786221 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:41.887702 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] validate_networks() for [('e3453d2d-2b7e-4051-9b69-5a0492d7260a', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:10:42.256576 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:10:42.257005 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:10:42.257512 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:10:42.257922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:10:42.258365 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:10:42.267188 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:42.267633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:42.268470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:42.268907 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:42.285138 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Getting quotas for project 8d5f63bad73c4a89b604c29290e4143f. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:10:42.289043 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Getting quotas for user afd423384efd459babccf3ff34214973 and project 8d5f63bad73c4a89b604c29290e4143f. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:10:42.300528 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:10:42.302755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:10:42.427900 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9a15a29e-2f22-4ae8-8336-b9d435223e90 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.654520 Jun 22 17:10:42.428520 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 450/869] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Jun 22 17:10:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 17:10:42.438934 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2a58e4aa-2ea4-4950-9911-15dddf65f058 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:42.439546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2a58e4aa-2ea4-4950-9911-15dddf65f058 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:42.442139 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:42.496986 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2a58e4aa-2ea4-4950-9911-15dddf65f058 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:42.504868 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2a58e4aa-2ea4-4950-9911-15dddf65f058 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:42.506303 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2a58e4aa-2ea4-4950-9911-15dddf65f058 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:42.507397 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2a58e4aa-2ea4-4950-9911-15dddf65f058 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1281 microversion: 2.20 time: 0.072850 Jun 22 17:10:42.507944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 420/870] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:42 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:43.525548 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:43.526281 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:43.533234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:43.533697 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:43.534456 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:43.534896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:43.539326 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=79 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:43.596147 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:43.604567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:43.606122 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:43.607207 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7d9ee74d-8e03-47b8-8c40-eb66c75bd418 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1277 microversion: 2.20 time: 0.086072 Jun 22 17:10:43.607756 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 451/871] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:43 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:44.626153 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:44.626776 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:44.634734 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:44.635194 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:44.635968 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:44.636433 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:44.639237 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:44.735827 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:44.744543 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:44.746051 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:44.747158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-62a37d4b-be65-4ef3-a289-5635f43ba2ea tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1339 microversion: 2.20 time: 0.125054 Jun 22 17:10:44.747703 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 421/872] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:44 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1339 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:45.765984 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:45.766784 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:45.774097 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:45.774604 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:45.775371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:45.775799 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:45.905419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:45.913441 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:45.915205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:45.916330 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5cc7b0c5-b48e-453d-9c80-29fa5173b509 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1406 microversion: 2.20 time: 0.154281 Jun 22 17:10:45.916875 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 452/873] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:45 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:46.288964 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-cc273079-d65d-48fa-9f0b-93f7b5298ebd req-680a5d2c-8a61-4380-abae-b812eaaefff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a539c2c-893b-45d9-b3a0-4242b0458c67", "tag": "fba9e631-9db1-4fcb-b461-46e4f03b9525"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:46.302045 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-cc273079-d65d-48fa-9f0b-93f7b5298ebd req-680a5d2c-8a61-4380-abae-b812eaaefff3 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:46.303806 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-cc273079-d65d-48fa-9f0b-93f7b5298ebd req-680a5d2c-8a61-4380-abae-b812eaaefff3 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:46.317065 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-cc273079-d65d-48fa-9f0b-93f7b5298ebd req-680a5d2c-8a61-4380-abae-b812eaaefff3 service nova] Creating event network-changed:fba9e631-9db1-4fcb-b461-46e4f03b9525 for instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 on hv-cinder-81045 Jun 22 17:10:46.322699 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-cc273079-d65d-48fa-9f0b-93f7b5298ebd req-680a5d2c-8a61-4380-abae-b812eaaefff3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039678 Jun 22 17:10:46.323686 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 422/874] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:10:46.934579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:46.935296 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:46.942332 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:46.942802 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:46.943565 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:46.944000 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:47.078698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:47.087242 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:47.088766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:47.089858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9ed80472-f0f1-48d0-918c-fe1e7e5dc0af tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1406 microversion: 2.20 time: 0.159242 Jun 22 17:10:47.090460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 453/875] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:46 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:48.107276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:48.107968 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:48.114629 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:48.115072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:48.115861 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:48.116339 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:48.243934 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:48.251718 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:48.253249 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:48.254338 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-195325fb-09e2-487f-a54c-0f2d405ae665 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1406 microversion: 2.20 time: 0.151361 Jun 22 17:10:48.254885 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 423/876] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:48 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:49.272812 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:49.273433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:49.279951 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:49.280435 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:49.281217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:49.281655 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:49.413257 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:49.421565 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:49.423067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:49.424251 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d27c9eeb-2105-4dca-83c8-c2bbab6d08b8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1406 microversion: 2.20 time: 0.155279 Jun 22 17:10:49.424797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 454/877] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:49 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:50.442525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:50.443873 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:50.450330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:50.450774 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:50.451523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:50.451949 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:50.575581 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:50.583269 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:50.584805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:50.585890 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-451a694f-1ffb-49c9-941d-06d29df68a41 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1406 microversion: 2.20 time: 0.147254 Jun 22 17:10:50.586438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 424/878] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:50 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:51.316326 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-fc55a100-a19a-4375-bccf-5b4319fd1b30 req-cbe05191-43e4-4714-91db-fe6ffbeabcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a539c2c-893b-45d9-b3a0-4242b0458c67", "name": "network-vif-plugged", "status": "completed", "tag": "fba9e631-9db1-4fcb-b461-46e4f03b9525"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:51.324738 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-fc55a100-a19a-4375-bccf-5b4319fd1b30 req-cbe05191-43e4-4714-91db-fe6ffbeabcb0 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:51.325175 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-fc55a100-a19a-4375-bccf-5b4319fd1b30 req-cbe05191-43e4-4714-91db-fe6ffbeabcb0 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:51.336267 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-fc55a100-a19a-4375-bccf-5b4319fd1b30 req-cbe05191-43e4-4714-91db-fe6ffbeabcb0 service nova] Creating event network-vif-plugged:fba9e631-9db1-4fcb-b461-46e4f03b9525 for instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 on hv-cinder-81045 Jun 22 17:10:51.341927 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-fc55a100-a19a-4375-bccf-5b4319fd1b30 req-cbe05191-43e4-4714-91db-fe6ffbeabcb0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028692 Jun 22 17:10:51.341927 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 455/879] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:10:51.602811 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:51.603427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:51.610530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:51.610986 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:51.611800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:51.612282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:51.801149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:51.808816 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:51.810300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:51.811379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cc06d7d1-b3c7-4228-9d7e-cd132892886b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1406 microversion: 2.20 time: 0.212578 Jun 22 17:10:51.811925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 425/880] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:51 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:52.826899 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:52.827744 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:52.832326 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:52.833062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:52.839961 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:52.844814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:52.844814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:52.844814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:52.978819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:52.986810 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:52.988339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:52.989463 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-62bdc6d8-f9de-439b-b250-7e5736b9ff39 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1406 microversion: 2.20 time: 0.163548 Jun 22 17:10:52.990028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 456/881] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:52 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:10:54.006760 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:54.007369 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:54.009337 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:54.014850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:54.025757 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:54.025757 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:54.025757 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:54.147062 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:54.154804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:54.156337 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:10:54.157473 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7d032cd2-b87b-41f9-b970-a610ebdd4e83 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1598 microversion: 2.20 time: 0.154606 Jun 22 17:10:54.158029 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 426/882] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:10:54 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:10:54.175272 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d87a37e2-0fb7-4c90-acec-1804e16c79a7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:10:54.175777 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d87a37e2-0fb7-4c90-acec-1804e16c79a7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:10:54.182088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d87a37e2-0fb7-4c90-acec-1804e16c79a7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:54.182531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d87a37e2-0fb7-4c90-acec-1804e16c79a7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:54.183317 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d87a37e2-0fb7-4c90-acec-1804e16c79a7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:54.183743 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d87a37e2-0fb7-4c90-acec-1804e16c79a7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:54.257808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d87a37e2-0fb7-4c90-acec-1804e16c79a7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086313 Jun 22 17:10:54.258357 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 457/883] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Jun 22 17:10:54 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 17:10:55.203127 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-c39eb9a9-6494-4531-b519-1b90b2772d54 req-7b3fdd58-a7f3-4549-9449-86c7a11baf2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a539c2c-893b-45d9-b3a0-4242b0458c67", "tag": "fba9e631-9db1-4fcb-b461-46e4f03b9525"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:10:55.211127 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-c39eb9a9-6494-4531-b519-1b90b2772d54 req-7b3fdd58-a7f3-4549-9449-86c7a11baf2b service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:10:55.211568 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-c39eb9a9-6494-4531-b519-1b90b2772d54 req-7b3fdd58-a7f3-4549-9449-86c7a11baf2b service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:10:55.222131 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-c39eb9a9-6494-4531-b519-1b90b2772d54 req-7b3fdd58-a7f3-4549-9449-86c7a11baf2b service nova] Creating event network-changed:fba9e631-9db1-4fcb-b461-46e4f03b9525 for instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 on hv-cinder-81045 Jun 22 17:10:55.227057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-c39eb9a9-6494-4531-b519-1b90b2772d54 req-7b3fdd58-a7f3-4549-9449-86c7a11baf2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027660 Jun 22 17:10:55.227812 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 427/884] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:11:44.817403 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:11:44.818220 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=35 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:11:44.822185 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d5049f11-bf1c-43bc-89fc-6087be20ec25 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:11:44.822704 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d5049f11-bf1c-43bc-89fc-6087be20ec25 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:11:44.829076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d5049f11-bf1c-43bc-89fc-6087be20ec25 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:11:44.829530 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d5049f11-bf1c-43bc-89fc-6087be20ec25 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:11:44.830297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d5049f11-bf1c-43bc-89fc-6087be20ec25 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:11:44.830736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d5049f11-bf1c-43bc-89fc-6087be20ec25 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:11:44.853156 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d5049f11-bf1c-43bc-89fc-6087be20ec25 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/ips" status: 200 len: 149 microversion: 2.1 time: 0.037526 Jun 22 17:11:44.853719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 458/885] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 17:11:44 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:11:47.673882 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f532c32c-372d-4b6b-9869-443353c97d73 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acca2825-3fda-4697-bd63-b358028af38f"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:11:47.675021 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f532c32c-372d-4b6b-9869-443353c97d73 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:11:47.677147 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=17 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:11:47.677789 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=33 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:11:47.682656 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f532c32c-372d-4b6b-9869-443353c97d73 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:11:47.683106 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f532c32c-372d-4b6b-9869-443353c97d73 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:11:47.683866 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f532c32c-372d-4b6b-9869-443353c97d73 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:11:47.684344 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f532c32c-372d-4b6b-9869-443353c97d73 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:11:48.353379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f532c32c-372d-4b6b-9869-443353c97d73 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684349 Jun 22 17:11:48.353978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 428/886] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:11:47 2022] POST /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:11:55.835379 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1abf30f5-f012-481d-b74f-64a5e72adedb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: .version_select at 0x7fe0a0563550>, body: {"keypair": {"name": "tempest-keypair-1857943553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnIc69IzNbf6wTM99fTkDPL0Su5HhbWr9nreNVcI8UJ3tvAaKLmpTFYuzS9ll17BoiA2oGjHRONoBEBvmwg1XDSfEpvY6KIe8RAjmuVJrip9rLOxJU6yHHfKiaeBJ/fIw=="}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:11:55.851436 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-1abf30f5-f012-481d-b74f-64a5e72adedb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for project 069840ebd26e434c861568668776df52. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:11:55.855171 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-1abf30f5-f012-481d-b74f-64a5e72adedb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for user 05951aa9ba2344a994f9fa1aa6fdb3bf and project 069840ebd26e434c861568668776df52. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:11:55.922925 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1abf30f5-f012-481d-b74f-64a5e72adedb tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091996 Jun 22 17:11:55.923516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 459/887] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:11:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:11:57.999233 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:11:58.003897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1858623065", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62ce7501-df82-41e9-98c8-d1402b2e1e32"}], "security_groups": [{"name": "tempest-securitygroup--220977931"}], "key_name": "tempest-keypair-1857943553", "user_data": "}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:11:58.106239 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] validate_networks() for [('62ce7501-df82-41e9-98c8-d1402b2e1e32', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:11:58.290577 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:11:58.472272 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:11:58.472720 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:11:58.473190 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:11:58.473596 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:11:58.474007 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:11:58.482817 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:11:58.483261 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:11:58.484053 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:11:58.484517 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:11:58.500710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for project 069840ebd26e434c861568668776df52. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:11:58.504585 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for user 05951aa9ba2344a994f9fa1aa6fdb3bf and project 069840ebd26e434c861568668776df52. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:11:58.516039 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:11:58.518382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:11:58.656010 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8c785242-79b2-4f30-be1d-cc4f005988ae tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.658765 Jun 22 17:11:58.656601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 429/888] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:11:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:11:58.667184 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-67911f46-44bc-4f84-8669-23152a5eb8c7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:11:58.667799 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-67911f46-44bc-4f84-8669-23152a5eb8c7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:11:58.723632 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-67911f46-44bc-4f84-8669-23152a5eb8c7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:11:58.731349 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-67911f46-44bc-4f84-8669-23152a5eb8c7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1242 microversion: 2.1 time: 0.068735 Jun 22 17:11:58.733552 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 460/889] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:11:58 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:11:59.749647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7e82a42c-94a8-4c17-92b7-ce47372b9a2c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:11:59.750282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7e82a42c-94a8-4c17-92b7-ce47372b9a2c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:11:59.757433 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e82a42c-94a8-4c17-92b7-ce47372b9a2c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:11:59.757881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e82a42c-94a8-4c17-92b7-ce47372b9a2c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:11:59.758636 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e82a42c-94a8-4c17-92b7-ce47372b9a2c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:11:59.759068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e82a42c-94a8-4c17-92b7-ce47372b9a2c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:11:59.819490 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7e82a42c-94a8-4c17-92b7-ce47372b9a2c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:11:59.827187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7e82a42c-94a8-4c17-92b7-ce47372b9a2c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1238 microversion: 2.1 time: 0.081733 Jun 22 17:11:59.828146 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 430/890] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:11:59 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:00.844488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2a4fa46b-cb2e-4434-82b4-edc64e43a8ab tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:00.845765 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2a4fa46b-cb2e-4434-82b4-edc64e43a8ab tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:00.852631 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2a4fa46b-cb2e-4434-82b4-edc64e43a8ab tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:00.853076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2a4fa46b-cb2e-4434-82b4-edc64e43a8ab tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:00.853851 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2a4fa46b-cb2e-4434-82b4-edc64e43a8ab tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:00.854284 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2a4fa46b-cb2e-4434-82b4-edc64e43a8ab tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:00.919330 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2a4fa46b-cb2e-4434-82b4-edc64e43a8ab tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:00.927423 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2a4fa46b-cb2e-4434-82b4-edc64e43a8ab tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1300 microversion: 2.1 time: 0.087036 Jun 22 17:12:00.927998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 461/891] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:00 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:01.945088 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6034da03-c046-427c-b100-7f17254b716f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:01.946285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6034da03-c046-427c-b100-7f17254b716f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:01.953740 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6034da03-c046-427c-b100-7f17254b716f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:01.954390 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6034da03-c046-427c-b100-7f17254b716f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:01.955175 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6034da03-c046-427c-b100-7f17254b716f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:01.955609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6034da03-c046-427c-b100-7f17254b716f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:02.191742 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6034da03-c046-427c-b100-7f17254b716f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:02.199579 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6034da03-c046-427c-b100-7f17254b716f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.258299 Jun 22 17:12:02.200327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 431/892] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:01 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:02.327262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-032a1697-f66f-4f2a-bf62-3885ae2661dc req-b1d55890-afa5-49a6-9043-db356e6b2452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e797a3-004c-4a1c-a5a4-338724ef129b", "tag": "65a17aad-b5aa-4451-b604-8f08297757a7"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:12:02.338552 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-032a1697-f66f-4f2a-bf62-3885ae2661dc req-b1d55890-afa5-49a6-9043-db356e6b2452 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:02.340349 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-032a1697-f66f-4f2a-bf62-3885ae2661dc req-b1d55890-afa5-49a6-9043-db356e6b2452 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:02.352378 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-032a1697-f66f-4f2a-bf62-3885ae2661dc req-b1d55890-afa5-49a6-9043-db356e6b2452 service nova] Creating event network-changed:65a17aad-b5aa-4451-b604-8f08297757a7 for instance 62e797a3-004c-4a1c-a5a4-338724ef129b on hv-cinder-81045 Jun 22 17:12:02.358133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-032a1697-f66f-4f2a-bf62-3885ae2661dc req-b1d55890-afa5-49a6-9043-db356e6b2452 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039566 Jun 22 17:12:02.358732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 462/893] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:12:03.215912 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-29f5b57e-1d94-465f-babe-d84fc170991e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:03.216643 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-29f5b57e-1d94-465f-babe-d84fc170991e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:03.223800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-29f5b57e-1d94-465f-babe-d84fc170991e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:03.224311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-29f5b57e-1d94-465f-babe-d84fc170991e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:03.225074 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-29f5b57e-1d94-465f-babe-d84fc170991e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:03.225501 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-29f5b57e-1d94-465f-babe-d84fc170991e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:03.354797 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-29f5b57e-1d94-465f-babe-d84fc170991e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:03.362045 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-29f5b57e-1d94-465f-babe-d84fc170991e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.150037 Jun 22 17:12:03.362623 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 432/894] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:03 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:04.379492 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-920cbc7d-1643-4144-ac95-7c55be46fc72 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:04.380223 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-920cbc7d-1643-4144-ac95-7c55be46fc72 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:04.386681 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-920cbc7d-1643-4144-ac95-7c55be46fc72 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:04.387146 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-920cbc7d-1643-4144-ac95-7c55be46fc72 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:04.387884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-920cbc7d-1643-4144-ac95-7c55be46fc72 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:04.388344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-920cbc7d-1643-4144-ac95-7c55be46fc72 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:04.515139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-920cbc7d-1643-4144-ac95-7c55be46fc72 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:04.522487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-920cbc7d-1643-4144-ac95-7c55be46fc72 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.147210 Jun 22 17:12:04.523042 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 463/895] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:04 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:05.539985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-691ae98c-6554-4d7b-8642-cee1b84b9094 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:05.540627 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-691ae98c-6554-4d7b-8642-cee1b84b9094 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:05.547844 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-691ae98c-6554-4d7b-8642-cee1b84b9094 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:05.548317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-691ae98c-6554-4d7b-8642-cee1b84b9094 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:05.549076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-691ae98c-6554-4d7b-8642-cee1b84b9094 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:05.549508 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-691ae98c-6554-4d7b-8642-cee1b84b9094 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:05.677173 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-691ae98c-6554-4d7b-8642-cee1b84b9094 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:05.684424 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-691ae98c-6554-4d7b-8642-cee1b84b9094 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.148339 Jun 22 17:12:05.684976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 433/896] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:05 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:06.701361 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e793da2d-08a5-413b-bc11-043fa2daae46 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:06.701968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e793da2d-08a5-413b-bc11-043fa2daae46 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:06.708511 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e793da2d-08a5-413b-bc11-043fa2daae46 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:06.708968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e793da2d-08a5-413b-bc11-043fa2daae46 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:06.709723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e793da2d-08a5-413b-bc11-043fa2daae46 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:06.710160 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e793da2d-08a5-413b-bc11-043fa2daae46 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:06.837838 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e793da2d-08a5-413b-bc11-043fa2daae46 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:06.845351 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e793da2d-08a5-413b-bc11-043fa2daae46 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.147898 Jun 22 17:12:06.845911 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 464/897] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:06 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:07.862515 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-243102b1-18ee-4f17-9c51-7855f50b0673 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:07.863140 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-243102b1-18ee-4f17-9c51-7855f50b0673 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:07.869623 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-243102b1-18ee-4f17-9c51-7855f50b0673 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:07.870127 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-243102b1-18ee-4f17-9c51-7855f50b0673 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:07.870887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-243102b1-18ee-4f17-9c51-7855f50b0673 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:07.871322 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-243102b1-18ee-4f17-9c51-7855f50b0673 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:08.002081 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-243102b1-18ee-4f17-9c51-7855f50b0673 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:08.009534 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-243102b1-18ee-4f17-9c51-7855f50b0673 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.150838 Jun 22 17:12:08.010206 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 434/898] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:07 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:09.026720 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b43fc096-3d11-49db-93c9-60f5e10c4766 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:09.027330 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b43fc096-3d11-49db-93c9-60f5e10c4766 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:09.029787 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:09.034684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b43fc096-3d11-49db-93c9-60f5e10c4766 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:09.035116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b43fc096-3d11-49db-93c9-60f5e10c4766 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:09.035924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b43fc096-3d11-49db-93c9-60f5e10c4766 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:09.036389 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b43fc096-3d11-49db-93c9-60f5e10c4766 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:09.162425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b43fc096-3d11-49db-93c9-60f5e10c4766 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:09.169987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b43fc096-3d11-49db-93c9-60f5e10c4766 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.147163 Jun 22 17:12:09.171108 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 465/899] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:09 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:09.606131 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:09.608802 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:09.725557 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-47732f57-ca34-4f4d-9c3b-06bb0dc64239 req-d8be0446-25ba-43c8-b3dc-970c8735e54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e797a3-004c-4a1c-a5a4-338724ef129b", "name": "network-vif-plugged", "status": "completed", "tag": "65a17aad-b5aa-4451-b604-8f08297757a7"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:12:09.734974 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-47732f57-ca34-4f4d-9c3b-06bb0dc64239 req-d8be0446-25ba-43c8-b3dc-970c8735e54b service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:09.735409 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-47732f57-ca34-4f4d-9c3b-06bb0dc64239 req-d8be0446-25ba-43c8-b3dc-970c8735e54b service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:09.746753 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-47732f57-ca34-4f4d-9c3b-06bb0dc64239 req-d8be0446-25ba-43c8-b3dc-970c8735e54b service nova] Creating event network-vif-plugged:65a17aad-b5aa-4451-b604-8f08297757a7 for instance 62e797a3-004c-4a1c-a5a4-338724ef129b on hv-cinder-81045 Jun 22 17:12:09.751942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-47732f57-ca34-4f4d-9c3b-06bb0dc64239 req-d8be0446-25ba-43c8-b3dc-970c8735e54b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150076 Jun 22 17:12:09.752924 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 435/900] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:12:10.187289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1da22edd-0bd4-40db-acb5-6cf4409e30ea tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:10.187910 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1da22edd-0bd4-40db-acb5-6cf4409e30ea tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:10.194462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1da22edd-0bd4-40db-acb5-6cf4409e30ea tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:10.194915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1da22edd-0bd4-40db-acb5-6cf4409e30ea tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:10.195677 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1da22edd-0bd4-40db-acb5-6cf4409e30ea tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:10.196126 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1da22edd-0bd4-40db-acb5-6cf4409e30ea tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:10.260642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b770a330-cfbd-4dbd-87f3-f40cd1d20536 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:10.261218 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b770a330-cfbd-4dbd-87f3-f40cd1d20536 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:10.267978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b770a330-cfbd-4dbd-87f3-f40cd1d20536 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:10.268447 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b770a330-cfbd-4dbd-87f3-f40cd1d20536 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:10.269210 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b770a330-cfbd-4dbd-87f3-f40cd1d20536 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:10.269640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b770a330-cfbd-4dbd-87f3-f40cd1d20536 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:10.294913 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b770a330-cfbd-4dbd-87f3-f40cd1d20536 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/ips" status: 200 len: 150 microversion: 2.20 time: 0.088817 Jun 22 17:12:10.295506 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 436/901] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Jun 22 17:12:10 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 17:12:10.330161 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1da22edd-0bd4-40db-acb5-6cf4409e30ea tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:10.337966 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1da22edd-0bd4-40db-acb5-6cf4409e30ea tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.155110 Jun 22 17:12:10.338542 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 466/902] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:10 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:11.354872 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a68ae17d-f869-4f6e-8c03-a929607fe352 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:11.355479 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a68ae17d-f869-4f6e-8c03-a929607fe352 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:11.362175 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a68ae17d-f869-4f6e-8c03-a929607fe352 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:11.362621 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a68ae17d-f869-4f6e-8c03-a929607fe352 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:11.363379 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a68ae17d-f869-4f6e-8c03-a929607fe352 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:11.363880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a68ae17d-f869-4f6e-8c03-a929607fe352 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:11.491518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a68ae17d-f869-4f6e-8c03-a929607fe352 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:11.499051 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a68ae17d-f869-4f6e-8c03-a929607fe352 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1367 microversion: 2.1 time: 0.148120 Jun 22 17:12:11.499642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 437/903] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:11 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:12:12.323351 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-02dc3e98-4749-4cb9-928d-e6edd51b76e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:12:12.324026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-02dc3e98-4749-4cb9-928d-e6edd51b76e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:12.330582 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02dc3e98-4749-4cb9-928d-e6edd51b76e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:12.331033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02dc3e98-4749-4cb9-928d-e6edd51b76e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:12.331797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02dc3e98-4749-4cb9-928d-e6edd51b76e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:12.332272 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-02dc3e98-4749-4cb9-928d-e6edd51b76e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:12.355396 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-02dc3e98-4749-4cb9-928d-e6edd51b76e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lazy-loading 'flavor' on Instance uuid 9a539c2c-893b-45d9-b3a0-4242b0458c67 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:12:12.515969 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8cc59624-9dff-401b-bc29-51ef0cd3ed64 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:12.516607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8cc59624-9dff-401b-bc29-51ef0cd3ed64 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:12.523080 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8cc59624-9dff-401b-bc29-51ef0cd3ed64 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:12.523525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8cc59624-9dff-401b-bc29-51ef0cd3ed64 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:12.524312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8cc59624-9dff-401b-bc29-51ef0cd3ed64 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:12.524744 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8cc59624-9dff-401b-bc29-51ef0cd3ed64 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:12.657637 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8cc59624-9dff-401b-bc29-51ef0cd3ed64 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:12.665412 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8cc59624-9dff-401b-bc29-51ef0cd3ed64 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1557 microversion: 2.1 time: 0.153065 Jun 22 17:12:12.666226 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 438/904] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:12:12 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:12:12.681995 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-91f149fb-bed5-44ce-a241-3ed98e4720ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:12.682488 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-91f149fb-bed5-44ce-a241-3ed98e4720ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:12.688561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-91f149fb-bed5-44ce-a241-3ed98e4720ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:12.689046 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-91f149fb-bed5-44ce-a241-3ed98e4720ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:12.690020 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-91f149fb-bed5-44ce-a241-3ed98e4720ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:12.690463 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-91f149fb-bed5-44ce-a241-3ed98e4720ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:12.766050 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-91f149fb-bed5-44ce-a241-3ed98e4720ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087790 Jun 22 17:12:12.766671 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 439/905] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 17:12:12 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:12:12.819652 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-02dc3e98-4749-4cb9-928d-e6edd51b76e0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/action" status: 202 len: 0 microversion: 2.20 time: 0.500113 Jun 22 17:12:12.820426 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 467/906] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 22 17:12:12 2022] POST /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:12:12.828933 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:12.829550 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:12.835953 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:12.836244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:12.837017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:12.837466 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:13.069772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:13.082350 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:13.087111 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:13.087545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aa513d43-5c8b-4706-bd5a-66b0bb1d1646 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.262650 Jun 22 17:12:13.088662 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 440/907] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:12 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:13.853628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-d6cff4c8-5b64-4373-977e-5489946482c8 req-e521fdf8-0e41-486a-a984-416d35871740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e797a3-004c-4a1c-a5a4-338724ef129b", "tag": "65a17aad-b5aa-4451-b604-8f08297757a7"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:12:13.862136 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-d6cff4c8-5b64-4373-977e-5489946482c8 req-e521fdf8-0e41-486a-a984-416d35871740 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:13.862572 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-d6cff4c8-5b64-4373-977e-5489946482c8 req-e521fdf8-0e41-486a-a984-416d35871740 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:13.873355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-d6cff4c8-5b64-4373-977e-5489946482c8 req-e521fdf8-0e41-486a-a984-416d35871740 service nova] Creating event network-changed:65a17aad-b5aa-4451-b604-8f08297757a7 for instance 62e797a3-004c-4a1c-a5a4-338724ef129b on hv-cinder-81045 Jun 22 17:12:13.878610 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-d6cff4c8-5b64-4373-977e-5489946482c8 req-e521fdf8-0e41-486a-a984-416d35871740 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029482 Jun 22 17:12:13.879192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 468/908] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:12:14.109709 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:14.110948 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:14.117633 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:14.118208 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:14.118989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:14.119425 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:14.327300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:14.335705 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:14.339996 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:14.339996 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a1930f1c-d6b9-419e-89f3-c6d60f664d44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.233237 Jun 22 17:12:14.339996 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 441/909] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:14 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:12:15.358211 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:15.359517 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:15.365653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:15.366098 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:15.366857 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:15.367290 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:15.496585 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:15.504392 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:15.505872 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:15.507050 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e73786b5-9569-4609-912d-601185806e6b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.153736 Jun 22 17:12:15.507629 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 469/910] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:15 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:16.524591 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:16.525202 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:16.532256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:16.532703 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:16.533464 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:16.533932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:16.656846 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:16.664526 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:16.666296 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:16.667420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-204e42f0-3ac9-44cc-a919-7e5e570cf082 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.146673 Jun 22 17:12:16.668027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 442/911] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:16 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:17.685335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:17.685938 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:17.692686 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:17.693133 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:17.693892 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:17.694322 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:17.818073 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:17.825981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:17.827516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:17.828701 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1b0be743-62c7-45b6-bdd6-b3200e451008 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.147251 Jun 22 17:12:17.829249 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 470/912] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:17 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:18.846750 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:18.847362 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:18.853817 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:18.854263 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:18.855018 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:18.855451 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:18.980910 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:18.989196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:18.990691 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:18.991837 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4d163cd4-80d1-4831-9bda-b884bf1630a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.149200 Jun 22 17:12:18.992424 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 443/913] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:18 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:20.010131 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:20.010720 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:20.017959 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:20.018410 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:20.019171 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:20.019611 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:20.157191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:20.165073 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:20.166883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:20.168035 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c472fa58-8eea-4e33-8912-f89ef7022593 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.161906 Jun 22 17:12:20.168617 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 471/914] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:20 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:21.186420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:21.187583 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:21.194104 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:21.194548 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:21.195304 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:21.195739 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:21.563568 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:21.571314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:21.572818 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:21.573961 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cac99490-3b6f-4d9c-9c55-54a00a89ce8d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.391408 Jun 22 17:12:21.574504 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 444/915] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:21 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:22.591995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:22.592630 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:22.599132 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:22.599579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:22.600370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:22.600804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:22.727845 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:22.736160 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:22.737665 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:22.738815 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-777c076b-f300-47fe-8a93-6123b2bec2b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.150751 Jun 22 17:12:22.739370 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 472/916] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:22 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:23.757100 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:23.757746 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:23.764300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:23.764752 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:23.765512 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:23.765947 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:23.891049 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:23.899268 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:23.900848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:23.901995 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-38a302e9-6281-42c7-93f7-45da854ace3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.148859 Jun 22 17:12:23.902546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 445/917] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:23 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:24.921673 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:24.922252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:24.928656 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:24.929110 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:24.929870 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:24.930304 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:25.066512 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:25.074278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:25.075797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:25.076970 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-19f4a254-8d8c-4f48-a595-ff679e15381b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1742 microversion: 2.20 time: 0.159754 Jun 22 17:12:25.077550 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 473/918] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:24 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:26.095340 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:26.095956 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:26.102104 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:26.102555 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:26.103319 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:26.103759 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:26.232702 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:26.241210 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:26.242756 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:26.243905 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4b696788-e0ff-44a1-8b2b-a38958e346f0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1742 microversion: 2.20 time: 0.153092 Jun 22 17:12:26.244503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 446/919] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:26 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:27.262819 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:27.263368 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:27.265738 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:27.270407 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:27.270847 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:27.271592 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:27.272020 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:27.275826 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:27.400730 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:27.408541 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:27.410056 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:27.411205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4ab0ed95-cc95-4a60-8217-7e05d805d980 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1742 microversion: 2.20 time: 0.152379 Jun 22 17:12:27.411756 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 474/920] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:27 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:28.429582 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:28.430169 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:28.432583 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:28.437268 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:28.438293 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:28.439063 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:28.439507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:28.442025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=97 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:28.564394 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:28.572014 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:28.573519 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:28.574652 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5de48490-8d07-4b61-acb6-5a70bded66a2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1742 microversion: 2.20 time: 0.148983 Jun 22 17:12:28.575204 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 447/921] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:28 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1742 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:29.592628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:29.593235 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:29.600777 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:29.601223 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:29.601990 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:29.602404 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:29.681458 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-835a0737-7e71-4222-809d-73af8c275c7e req-9562f9fe-fd35-4890-8123-de3532736f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a539c2c-893b-45d9-b3a0-4242b0458c67", "name": "network-vif-plugged", "status": "completed", "tag": "fba9e631-9db1-4fcb-b461-46e4f03b9525"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:12:29.692599 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-835a0737-7e71-4222-809d-73af8c275c7e req-9562f9fe-fd35-4890-8123-de3532736f7e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:29.693044 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-835a0737-7e71-4222-809d-73af8c275c7e req-9562f9fe-fd35-4890-8123-de3532736f7e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:29.705746 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-835a0737-7e71-4222-809d-73af8c275c7e req-9562f9fe-fd35-4890-8123-de3532736f7e service nova] Creating event network-vif-plugged:fba9e631-9db1-4fcb-b461-46e4f03b9525 for instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 on hv-cinder-81045 Jun 22 17:12:29.711034 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-835a0737-7e71-4222-809d-73af8c275c7e req-9562f9fe-fd35-4890-8123-de3532736f7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Jun 22 17:12:29.712471 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 448/922] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:12:29.742383 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:29.750719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:29.752232 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:29.753442 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6dbd81a5-3a91-4f4d-aee3-7667fddb376f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.164793 Jun 22 17:12:29.753989 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 475/923] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:29 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:30.771235 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:30.772376 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:30.780207 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:30.793948 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:30.793948 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:30.793948 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:30.955011 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:30.963889 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:30.965561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:30.967192 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bd91f107-9e25-4892-8fd3-e7287366a5b3 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.200207 Jun 22 17:12:30.967967 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 449/924] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:30 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:31.989539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:31.990134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:31.996941 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:31.997413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:31.998228 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:31.998679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:32.139214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:32.148598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:32.150411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:32.151792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ee4934a8-d8fa-4f46-8cdf-5eed0333771d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.166046 Jun 22 17:12:32.152578 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 476/925] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:31 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:33.171294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:33.171893 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:33.178495 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:33.178939 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:33.179719 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:33.180172 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:33.345286 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:33.358424 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:33.361776 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:33.364559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-59fc1816-f4e9-475a-b4a7-949380123393 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.196826 Jun 22 17:12:33.365704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 450/926] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:33 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:12:34.384062 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:34.384733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:34.391581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:34.392191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:34.393041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:34.393566 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:34.537152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:34.546172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:34.547932 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:34.549173 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cf6815bf-8c09-47c7-8e8d-5eb3b1af030c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.169057 Jun 22 17:12:34.552391 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 477/927] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:34 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:35.567188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:35.568599 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:35.575068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:35.575518 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:35.576310 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:35.576747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:35.710021 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:35.717244 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:35.719268 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:35.720480 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3b4bc90f-b08c-47f4-9545-880a7e0197b9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.157121 Jun 22 17:12:35.721037 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 451/928] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:35 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:36.738814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:36.739471 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:36.745948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:36.746398 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:36.747186 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:36.747644 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:36.900427 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:36.908829 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:36.911005 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:36.912341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2b10d810-ace2-471b-b719-3feae80599da tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.177618 Jun 22 17:12:36.912898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 478/929] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:36 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:37.930768 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:37.932096 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:37.945002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:37.945798 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:37.946815 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:37.947464 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:38.095255 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:38.107451 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:38.109027 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:38.110723 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1c8c219c-1820-4ca8-9fc9-88465e13bd78 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.183887 Jun 22 17:12:38.111282 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 452/930] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:37 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:39.131988 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:39.132564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:39.140214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:39.141185 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:39.142005 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:39.142501 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:39.334314 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:39.334314 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:39.334551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:39.334551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2c5ef45f-a4f9-4e09-bccf-4d30158f28a9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.169609 Jun 22 17:12:39.334551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 479/931] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:39 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:40.318696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:40.319253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:40.325591 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:40.326036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:40.326786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:40.327221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:40.464584 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:40.472426 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:40.473919 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:40.475061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-538163dc-b12e-465d-90eb-4b96b4a8ee3b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1737 microversion: 2.20 time: 0.160314 Jun 22 17:12:40.475608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 453/932] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:40 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:41.493817 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:41.498499 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:41.501881 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:41.502471 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:41.503234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:41.503662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:41.645596 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:41.653715 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:41.655300 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:41.657232 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-86abf772-f541-4563-a5fa-838cdf4c7903 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1719 microversion: 2.20 time: 0.167505 Jun 22 17:12:41.657874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 480/933] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:41 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:42.676513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:42.677145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:42.683408 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:42.683850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:42.685722 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:42.685722 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:42.818506 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:42.826450 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:42.827932 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:42.829097 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-eedfb7dd-c3a0-4531-9d8d-9e915a4b6064 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1719 microversion: 2.20 time: 0.156513 Jun 22 17:12:42.829648 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 454/934] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:42 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:43.847597 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:43.848265 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:43.854870 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:43.855262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:43.856048 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:43.856510 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:43.984211 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:43.992431 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:43.993987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:43.995123 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7be865ed-d5d3-4622-be4f-45b792a188f2 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1722 microversion: 2.20 time: 0.151928 Jun 22 17:12:43.995666 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 481/935] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:43 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:44.012474 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-79a5e5ee-b483-491d-87af-554d388dfdd7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8d55598-bab0-4562-87be-2f46c7890c13"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:12:44.013563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-79a5e5ee-b483-491d-87af-554d388dfdd7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:44.020130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-79a5e5ee-b483-491d-87af-554d388dfdd7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:44.020632 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-79a5e5ee-b483-491d-87af-554d388dfdd7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:44.021364 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-79a5e5ee-b483-491d-87af-554d388dfdd7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:44.021803 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-79a5e5ee-b483-491d-87af-554d388dfdd7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:44.834498 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-79a5e5ee-b483-491d-87af-554d388dfdd7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.826044 Jun 22 17:12:44.835095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 455/936] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Jun 22 17:12:44 2022] POST /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/os-volume_attachments => generated 188 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 17:12:44.950544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9a3be5ea-409b-4cc8-a7a8-041209d8c9f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:44.951041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9a3be5ea-409b-4cc8-a7a8-041209d8c9f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:44.958088 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9a3be5ea-409b-4cc8-a7a8-041209d8c9f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:44.958531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9a3be5ea-409b-4cc8-a7a8-041209d8c9f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:44.959334 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9a3be5ea-409b-4cc8-a7a8-041209d8c9f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:44.959767 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9a3be5ea-409b-4cc8-a7a8-041209d8c9f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:45.565898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9a3be5ea-409b-4cc8-a7a8-041209d8c9f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/os-volume_attachments/f8d55598-bab0-4562-87be-2f46c7890c13" status: 202 len: 0 microversion: 2.20 time: 0.619357 Jun 22 17:12:45.566516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 482/937] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Jun 22 17:12:44 2022] DELETE /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/os-volume_attachments/f8d55598-bab0-4562-87be-2f46c7890c13 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:12:45.621742 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8915dca5-b3be-41b7-81a7-38698335e085 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:12:45.622302 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8915dca5-b3be-41b7-81a7-38698335e085 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:45.631600 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8915dca5-b3be-41b7-81a7-38698335e085 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:45.632040 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8915dca5-b3be-41b7-81a7-38698335e085 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:45.633020 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8915dca5-b3be-41b7-81a7-38698335e085 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:45.633454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8915dca5-b3be-41b7-81a7-38698335e085 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:45.728299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-6c5c2ca4-0e1f-4f21-8feb-d446eb5e64d0 req-8fa335af-cb02-4712-8ee8-d5cf59cf6710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a539c2c-893b-45d9-b3a0-4242b0458c67", "name": "network-vif-unplugged", "status": "completed", "tag": "fba9e631-9db1-4fcb-b461-46e4f03b9525"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:12:45.739295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-6c5c2ca4-0e1f-4f21-8feb-d446eb5e64d0 req-8fa335af-cb02-4712-8ee8-d5cf59cf6710 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:45.739743 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-6c5c2ca4-0e1f-4f21-8feb-d446eb5e64d0 req-8fa335af-cb02-4712-8ee8-d5cf59cf6710 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:45.749864 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.compute.server_external_events [req-6c5c2ca4-0e1f-4f21-8feb-d446eb5e64d0 req-8fa335af-cb02-4712-8ee8-d5cf59cf6710 service nova] Unable to find a host for instance 9a539c2c-893b-45d9-b3a0-4242b0458c67. Dropping event network-vif-unplugged {{(pid=118471) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 17:12:45.750717 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-6c5c2ca4-0e1f-4f21-8feb-d446eb5e64d0 req-8fa335af-cb02-4712-8ee8-d5cf59cf6710 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026363 Jun 22 17:12:45.751284 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 483/938] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 22 17:12:45.854199 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8915dca5-b3be-41b7-81a7-38698335e085 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "POST /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/action" status: 202 len: 0 microversion: 2.20 time: 0.236637 Jun 22 17:12:45.854809 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 456/939] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 22 17:12:45 2022] POST /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:12:45.863019 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:45.863679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:45.876083 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:45.876564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:45.877344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:45.877783 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:46.008738 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:46.014761 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:46.016928 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:46.018087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-652744d1-08ab-4540-8add-46ff83fadfa7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1670 microversion: 2.20 time: 0.159142 Jun 22 17:12:46.018632 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 484/940] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:45 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:47.037317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:47.037920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:47.044074 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:47.044558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:47.045307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:47.045736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:47.181064 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:47.189294 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:47.190775 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:47.191915 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-169ad9a4-67d3-4cc9-9e9f-fed6caa46a44 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1670 microversion: 2.20 time: 0.159003 Jun 22 17:12:47.192522 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 457/941] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:47 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:48.210788 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:48.211404 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:48.217900 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:48.218355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:48.219126 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:48.219564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:48.615374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:48.623344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:48.624974 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:48.626178 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1df5a865-7c80-4045-bd4f-157b0aa723f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.419243 Jun 22 17:12:48.626662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 485/942] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:48 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:49.645131 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:49.645893 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:49.652673 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:49.653116 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:49.653908 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:49.654338 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:49.807696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:49.816206 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:49.817931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:49.819103 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-07227930-ba8d-4989-8a67-51379e88cb8c tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.178252 Jun 22 17:12:49.819816 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 458/943] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:49 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:50.836814 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:50.837513 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:50.843980 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:50.844459 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:50.845301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:50.845770 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:50.991988 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:51.000456 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:51.002626 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:51.003850 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1de358df-2276-476c-830e-513d90a8b82b tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.171094 Jun 22 17:12:51.004470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 486/944] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:50 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:52.022748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:52.024484 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:52.031847 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:52.032338 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:52.033107 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:52.033538 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:52.171276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:52.179635 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:52.181227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:52.182311 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-00a83ac4-0482-4fca-b400-f2e396b8b08f tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.163571 Jun 22 17:12:52.182866 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 459/945] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:52 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:53.201664 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:53.202214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:53.209526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:53.211684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:53.211684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:53.211684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:53.351607 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:53.359477 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:53.361509 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:53.362653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7afcb67a-a5df-46b9-87ab-b9f7c47364ee tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.165475 Jun 22 17:12:53.363212 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 487/946] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:53 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:54.381012 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:54.382413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:54.389222 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:54.389762 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:54.390605 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:54.391107 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:54.523203 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:54.525546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:54.532000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:54.534119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:54.535231 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-27400173-d0b9-4ed3-a2b7-4c07af6d5a27 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.158273 Jun 22 17:12:54.535875 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 460/947] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:54 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:55.554776 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:55.604480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:55.604480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:55.604480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:55.604480 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:55.605394 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:55.712891 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:55.716399 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:55.721947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:55.723458 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:55.724749 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2408a798-6229-48a2-bdc8-87480854ac19 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.174424 Jun 22 17:12:55.725531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 488/948] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:55 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:56.745370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:56.746005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:56.753278 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:56.753734 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:56.754505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:56.754935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:56.909383 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:56.918238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:56.923975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:56.923975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f16cad59-0676-4da2-9d8a-ec9944ed9911 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.181627 Jun 22 17:12:56.923975 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 461/949] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:56 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:57.940570 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:57.941176 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:57.943825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=30 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:57.948788 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:57.949239 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:57.949979 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:57.950407 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:58.081596 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:58.089355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:58.090843 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:58.091982 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-030f7c00-0afa-4008-b78b-0e7ea8a02f2a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.156012 Jun 22 17:12:58.092567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 489/950] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:57 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:12:59.111364 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:12:59.111969 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:12:59.114222 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=32 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:59.118968 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:59.119416 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:59.120206 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:12:59.120645 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:12:59.250888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:59.259158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:59.260698 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:12:59.261835 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-08bc719c-03ee-4de0-9875-e5cf0247c516 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.155159 Jun 22 17:12:59.262376 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 462/951] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:12:59 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:00.280033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:00.280603 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:00.287001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:00.287443 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:00.288224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:00.288651 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:00.424089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:00.432722 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:00.436841 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:00.436841 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-600e90bb-67d4-400e-9be9-2c46a2d49b1d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.159503 Jun 22 17:13:00.436841 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 490/952] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:00 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:01.453183 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:01.453795 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:01.460382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:01.460836 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:01.461681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:01.462125 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:01.589214 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:01.596904 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:01.598370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:01.599505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9c2a9e6d-8cf2-414c-aeb1-afe35b4bc302 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.150326 Jun 22 17:13:01.600056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 463/953] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:01 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:02.617425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:02.618082 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:02.624778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:02.625230 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:02.626648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:02.626946 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:02.879424 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:02.879424 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:02.880608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:02.880608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-85a23b73-d7ac-4233-af97-8b5ea5d10351 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.167337 Jun 22 17:13:02.880608 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 491/954] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:02 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:03.799065 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:03.799656 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:03.806036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:03.806484 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:03.807238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:03.807668 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:03.938343 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:03.946498 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:03.948098 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:03.949291 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0c66de31-e8ec-4584-81a6-86474c99dcd9 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.154087 Jun 22 17:13:03.949837 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 464/955] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:03 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:04.967818 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:04.968458 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:04.975047 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:04.975492 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:04.976287 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:04.976721 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:05.106951 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:05.114937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:05.116460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:05.117662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7823fd1a-5eb8-4614-924d-6933976012a8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.153872 Jun 22 17:13:05.118175 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 492/956] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:04 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:05.915145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-505afd16-9c78-4a51-8b3a-5a24487f74cf req-ebca465d-e98f-4c1b-b6a4-108439aa0d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a539c2c-893b-45d9-b3a0-4242b0458c67", "name": "network-vif-plugged", "status": "completed", "tag": "fba9e631-9db1-4fcb-b461-46e4f03b9525"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:13:05.924329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-505afd16-9c78-4a51-8b3a-5a24487f74cf req-ebca465d-e98f-4c1b-b6a4-108439aa0d88 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:05.924907 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-505afd16-9c78-4a51-8b3a-5a24487f74cf req-ebca465d-e98f-4c1b-b6a4-108439aa0d88 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:05.935295 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-505afd16-9c78-4a51-8b3a-5a24487f74cf req-ebca465d-e98f-4c1b-b6a4-108439aa0d88 service nova] Creating event network-vif-plugged:fba9e631-9db1-4fcb-b461-46e4f03b9525 for instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 on hv-cinder-81045 Jun 22 17:13:05.948507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-505afd16-9c78-4a51-8b3a-5a24487f74cf req-ebca465d-e98f-4c1b-b6a4-108439aa0d88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029390 Jun 22 17:13:05.948507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 465/957] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:06.135803 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:06.136507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:06.143081 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:06.143560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:06.144424 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:06.144860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:06.275697 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:06.284491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:06.285919 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:06.287084 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6e02d283-ebe2-4915-9bf3-fc66912000f1 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.155319 Jun 22 17:13:06.287641 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 493/958] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:06 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:07.307234 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:07.307835 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:07.314545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:07.314984 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:07.315731 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:07.316182 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:07.446329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:07.454041 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:07.455521 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:07.456710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1089dd97-cbd4-4241-b3aa-91098b35ecd0 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.154695 Jun 22 17:13:07.457288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 466/959] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:07 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:08.475903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:08.476600 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:08.483367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:08.486731 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:08.486731 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:08.486731 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:08.621824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:08.630703 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:08.632623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:08.633821 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f60a63cb-d9f7-446d-9307-42de76bd9856 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1728 microversion: 2.20 time: 0.162421 Jun 22 17:13:08.634543 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 494/960] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:08 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:13:09.652014 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:09.652647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:09.659605 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:09.660045 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:09.660823 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:09.661253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:09.784567 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:09.792900 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:09.794392 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:09.795537 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-091d9895-28ac-4816-a464-c9a067dc99b6 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1715 microversion: 2.20 time: 0.147390 Jun 22 17:13:09.796068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 467/961] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:13:09 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1715 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:13:29.055644 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-79520941-32d3-4dd2-82a2-94c4a37247a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:29.056215 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-79520941-32d3-4dd2-82a2-94c4a37247a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:29.058663 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=11 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:29.059321 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=36 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:29.064039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-79520941-32d3-4dd2-82a2-94c4a37247a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:29.064516 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-79520941-32d3-4dd2-82a2-94c4a37247a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:29.065278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-79520941-32d3-4dd2-82a2-94c4a37247a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:29.065713 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-79520941-32d3-4dd2-82a2-94c4a37247a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:29.089144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-79520941-32d3-4dd2-82a2-94c4a37247a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037400 Jun 22 17:13:29.089708 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 495/962] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 17:13:29 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:29.100133 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acca2825-3fda-4697-bd63-b358028af38f"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:13:29.101184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:29.103406 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=11 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:29.104074 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=39 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:29.108724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:29.109196 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:29.109947 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:29.110375 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:29.187225 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Invalid volume: volume acca2825-3fda-4697-bd63-b358028af38f is already attached to instances: fcb371f6-ae21-429b-a7e4-d43500167025 Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: POST /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b/os-volume_attachments HTTP/1.1 Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 74 Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:13:29.188970 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {"volumeAttachment": {"volumeId": "acca2825-3fda-4697-bd63-b358028af38f"}} Jun 22 17:13:29.190420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Invalid volume: volume acca2825-3fda-4697-bd63-b358028af38f is already attached to instances: fcb371f6-ae21-429b-a7e4-d43500167025 Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'server_id': '62e797a3-004c-4a1c-a5a4-338724ef129b', 'body': {'volumeAttachment': {'volumeId': 'acca2825-3fda-4697-bd63-b358028af38f'}}} Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume acca2825-3fda-4697-bd63-b358028af38f is already attached to instances: fcb371f6-ae21-429b-a7e4-d43500167025 Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:13:29.191321 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume acca2825-3fda-4697-bd63-b358028af38f is already attached to instances: fcb371f6-ae21-429b-a7e4-d43500167025 Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:29.193496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:13:29.195187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:13:29.195187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:13:29.195187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:13:29.195187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume acca2825-3fda-4697-bd63-b358028af38f is already attached to instances: fcb371f6-ae21-429b-a7e4-d43500167025 Jun 22 17:13:29.195187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:13:29.195187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 400 to user: Invalid volume: volume acca2825-3fda-4697-bd63-b358028af38f is already attached to instances: fcb371f6-ae21-429b-a7e4-d43500167025 {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:13:29.195187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7daa1e57-fd8f-4ccf-8376-1e1bf0353593 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094298 Jun 22 17:13:29.195187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 468/963] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:13:29 2022] POST /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 17:13:29.199912 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7f150861-6860-4a85-9538-e09766346a4b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:29.200442 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7f150861-6860-4a85-9538-e09766346a4b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:29.206676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7f150861-6860-4a85-9538-e09766346a4b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:29.207115 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7f150861-6860-4a85-9538-e09766346a4b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:29.207885 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7f150861-6860-4a85-9538-e09766346a4b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:29.208422 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7f150861-6860-4a85-9538-e09766346a4b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:29.232816 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7f150861-6860-4a85-9538-e09766346a4b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:13:29.474411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7f150861-6860-4a85-9538-e09766346a4b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 204 len: 0 microversion: 2.1 time: 0.277710 Jun 22 17:13:29.474922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 496/964] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:13:29 2022] DELETE /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:13:29.483000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9f5d1937-d419-4cfb-a5d5-dbef8b422dc9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:29.483617 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9f5d1937-d419-4cfb-a5d5-dbef8b422dc9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:29.490507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f5d1937-d419-4cfb-a5d5-dbef8b422dc9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:29.490949 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f5d1937-d419-4cfb-a5d5-dbef8b422dc9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:29.491709 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f5d1937-d419-4cfb-a5d5-dbef8b422dc9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:29.492170 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f5d1937-d419-4cfb-a5d5-dbef8b422dc9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:29.621985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9f5d1937-d419-4cfb-a5d5-dbef8b422dc9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:29.629460 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9f5d1937-d419-4cfb-a5d5-dbef8b422dc9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1682 microversion: 2.1 time: 0.150332 Jun 22 17:13:29.630017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 469/965] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:29 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:13:30.648998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7d186c41-dc8f-480b-af11-a8e4f1661e87 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:30.649707 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7d186c41-dc8f-480b-af11-a8e4f1661e87 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:30.656089 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7d186c41-dc8f-480b-af11-a8e4f1661e87 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:30.656558 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7d186c41-dc8f-480b-af11-a8e4f1661e87 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:30.657355 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7d186c41-dc8f-480b-af11-a8e4f1661e87 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:30.657787 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7d186c41-dc8f-480b-af11-a8e4f1661e87 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:30.784320 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7d186c41-dc8f-480b-af11-a8e4f1661e87 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:30.793021 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7d186c41-dc8f-480b-af11-a8e4f1661e87 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1682 microversion: 2.1 time: 0.148724 Jun 22 17:13:30.793592 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 497/966] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:30 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:31.810356 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ae899472-a42f-4e70-adc9-943e9095533b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:31.810969 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ae899472-a42f-4e70-adc9-943e9095533b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:31.817489 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ae899472-a42f-4e70-adc9-943e9095533b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:31.817935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ae899472-a42f-4e70-adc9-943e9095533b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:31.818697 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ae899472-a42f-4e70-adc9-943e9095533b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:31.819133 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ae899472-a42f-4e70-adc9-943e9095533b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:32.030665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ae899472-a42f-4e70-adc9-943e9095533b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:32.038825 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ae899472-a42f-4e70-adc9-943e9095533b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1682 microversion: 2.1 time: 0.232451 Jun 22 17:13:32.039381 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 470/967] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:31 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:32.504189 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-423d78a6-45eb-4100-8638-10f81e1ce257 req-6bd29ae2-79a0-483e-802b-138da022a7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e797a3-004c-4a1c-a5a4-338724ef129b", "name": "network-vif-deleted", "tag": "65a17aad-b5aa-4451-b604-8f08297757a7"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:13:32.513951 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-423d78a6-45eb-4100-8638-10f81e1ce257 req-6bd29ae2-79a0-483e-802b-138da022a7f9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:32.518795 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-423d78a6-45eb-4100-8638-10f81e1ce257 req-6bd29ae2-79a0-483e-802b-138da022a7f9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:32.525895 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-423d78a6-45eb-4100-8638-10f81e1ce257 req-6bd29ae2-79a0-483e-802b-138da022a7f9 service nova] Creating event network-vif-deleted:65a17aad-b5aa-4451-b604-8f08297757a7 for instance 62e797a3-004c-4a1c-a5a4-338724ef129b on hv-cinder-81045 Jun 22 17:13:32.530881 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-423d78a6-45eb-4100-8638-10f81e1ce257 req-6bd29ae2-79a0-483e-802b-138da022a7f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030507 Jun 22 17:13:32.531467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 498/968] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:33.056759 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:33.057289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:33.063597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:33.064036 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:33.064814 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:33.065241 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:33.095672 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:33.096130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:33.096584 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lazy-loading 'fault' on Instance uuid 62e797a3-004c-4a1c-a5a4-338724ef129b {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:13:33.138448 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:33.146524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9a124429-34df-441b-90f1-c26ec15d5351 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 200 len: 1332 microversion: 2.1 time: 0.093654 Jun 22 17:13:33.147614 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 471/969] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:33 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:34.164687 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:34.165378 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:34.171776 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:34.172311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:34.173058 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:34.173484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:34.187033 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b HTTP/1.1 Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:13:34.188638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:13:34.190278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '62e797a3-004c-4a1c-a5a4-338724ef129b'} Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:13:34.191214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:13:34.192858 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:34.194182 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:13:34.194182 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a5171737-6bd1-4992-84e6-a48dd8c85caa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 404 len: 111 microversion: 2.1 time: 0.030549 Jun 22 17:13:34.194182 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 499/970] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:34 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:13:34.198637 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-48f48d8e-3c54-4b6f-a990-bc3b77897c60 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '.version_select at 0x7fe0a038e4c0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:34.280717 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-48f48d8e-3c54-4b6f-a990-bc3b77897c60 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857943553" status: 202 len: 0 microversion: 2.1 time: 0.085740 Jun 22 17:13:34.281219 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 472/971] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 22 17:13:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857943553 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:13:35.053253 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-08bc127e-6b45-463b-9b48-dec396e3d5a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:35.053869 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-08bc127e-6b45-463b-9b48-dec396e3d5a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:35.059978 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-08bc127e-6b45-463b-9b48-dec396e3d5a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:35.060572 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-08bc127e-6b45-463b-9b48-dec396e3d5a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:35.061606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-08bc127e-6b45-463b-9b48-dec396e3d5a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:35.062041 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-08bc127e-6b45-463b-9b48-dec396e3d5a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:35.142044 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-08bc127e-6b45-463b-9b48-dec396e3d5a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lazy-loading 'services' on Instance uuid fcb371f6-ae21-429b-a7e4-d43500167025 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:13:35.353586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-08bc127e-6b45-463b-9b48-dec396e3d5a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments/acca2825-3fda-4697-bd63-b358028af38f" status: 202 len: 0 microversion: 2.1 time: 0.304936 Jun 22 17:13:35.354228 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 500/972] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:13:35 2022] DELETE /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments/acca2825-3fda-4697-bd63-b358028af38f => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:13:35.363080 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c8e1a766-7318-4db2-b556-fe4f45a2c105 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:35.364644 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c8e1a766-7318-4db2-b556-fe4f45a2c105 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:35.371380 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c8e1a766-7318-4db2-b556-fe4f45a2c105 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:35.371826 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c8e1a766-7318-4db2-b556-fe4f45a2c105 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:35.372623 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c8e1a766-7318-4db2-b556-fe4f45a2c105 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:35.373057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c8e1a766-7318-4db2-b556-fe4f45a2c105 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:35.400863 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c8e1a766-7318-4db2-b556-fe4f45a2c105 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042315 Jun 22 17:13:35.401333 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 473/973] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:13:35 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:36.413535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f166112c-36ff-4a4a-ba06-456d4470bf9c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:36.414629 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f166112c-36ff-4a4a-ba06-456d4470bf9c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:36.421289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f166112c-36ff-4a4a-ba06-456d4470bf9c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:36.424682 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f166112c-36ff-4a4a-ba06-456d4470bf9c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:36.424682 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f166112c-36ff-4a4a-ba06-456d4470bf9c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:36.424682 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f166112c-36ff-4a4a-ba06-456d4470bf9c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:36.451150 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f166112c-36ff-4a4a-ba06-456d4470bf9c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042427 Jun 22 17:13:36.453375 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 501/974] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:13:36 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:37.463272 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-69554c35-09e8-48e7-aac7-90ba2d4d05ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:37.464209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-69554c35-09e8-48e7-aac7-90ba2d4d05ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:37.470576 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-69554c35-09e8-48e7-aac7-90ba2d4d05ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:37.471021 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-69554c35-09e8-48e7-aac7-90ba2d4d05ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:37.471771 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-69554c35-09e8-48e7-aac7-90ba2d4d05ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:37.472300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-69554c35-09e8-48e7-aac7-90ba2d4d05ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:37.499620 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-69554c35-09e8-48e7-aac7-90ba2d4d05ef tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040290 Jun 22 17:13:37.500178 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 474/975] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:13:37 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 17:13:37.556462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-879d9f61-5279-4b25-a814-3b7e3d15f3b9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:37.556958 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-879d9f61-5279-4b25-a814-3b7e3d15f3b9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:37.563226 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-879d9f61-5279-4b25-a814-3b7e3d15f3b9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:37.563669 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-879d9f61-5279-4b25-a814-3b7e3d15f3b9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:37.564450 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-879d9f61-5279-4b25-a814-3b7e3d15f3b9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:37.564878 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-879d9f61-5279-4b25-a814-3b7e3d15f3b9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:37.591879 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-879d9f61-5279-4b25-a814-3b7e3d15f3b9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:13:37.897717 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-879d9f61-5279-4b25-a814-3b7e3d15f3b9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 204 len: 0 microversion: 2.1 time: 0.344798 Jun 22 17:13:37.898335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 502/976] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:13:37 2022] DELETE /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:13:37.906567 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cea4b098-0f85-4b05-a230-02b62baf337d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:37.907181 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cea4b098-0f85-4b05-a230-02b62baf337d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:37.913153 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cea4b098-0f85-4b05-a230-02b62baf337d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:37.913606 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cea4b098-0f85-4b05-a230-02b62baf337d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:37.914368 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cea4b098-0f85-4b05-a230-02b62baf337d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:37.914807 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cea4b098-0f85-4b05-a230-02b62baf337d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:38.042764 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cea4b098-0f85-4b05-a230-02b62baf337d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:38.050386 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cea4b098-0f85-4b05-a230-02b62baf337d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1680 microversion: 2.1 time: 0.147696 Jun 22 17:13:38.050937 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 475/977] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:37 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:13:39.068801 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-95ee3a16-77b7-40f1-abb7-350e602e846c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:39.069610 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-95ee3a16-77b7-40f1-abb7-350e602e846c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:39.076231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-95ee3a16-77b7-40f1-abb7-350e602e846c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:39.076677 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-95ee3a16-77b7-40f1-abb7-350e602e846c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:39.077423 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-95ee3a16-77b7-40f1-abb7-350e602e846c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:39.077853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-95ee3a16-77b7-40f1-abb7-350e602e846c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:39.210153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-95ee3a16-77b7-40f1-abb7-350e602e846c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:39.217535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-95ee3a16-77b7-40f1-abb7-350e602e846c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1680 microversion: 2.1 time: 0.153607 Jun 22 17:13:39.218097 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 503/978] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:39 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:40.234629 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6370e697-8c2a-4a15-8525-38b73c61b64b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:40.235240 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6370e697-8c2a-4a15-8525-38b73c61b64b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:40.242649 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6370e697-8c2a-4a15-8525-38b73c61b64b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:40.243092 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6370e697-8c2a-4a15-8525-38b73c61b64b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:40.243843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6370e697-8c2a-4a15-8525-38b73c61b64b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:40.244305 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6370e697-8c2a-4a15-8525-38b73c61b64b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:40.414999 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6370e697-8c2a-4a15-8525-38b73c61b64b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:40.422881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6370e697-8c2a-4a15-8525-38b73c61b64b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1680 microversion: 2.1 time: 0.192026 Jun 22 17:13:40.423437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 476/979] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:40 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:41.016086 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-17588ce5-72ec-4727-98d9-fe92dc05ef98 req-5fdff90f-5a43-473f-ae1b-9879022cf228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb371f6-ae21-429b-a7e4-d43500167025", "name": "network-vif-deleted", "tag": "f3ff402f-3af5-42df-8ae8-00f340bfd75d"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:13:41.029200 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-17588ce5-72ec-4727-98d9-fe92dc05ef98 req-5fdff90f-5a43-473f-ae1b-9879022cf228 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:41.029886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-17588ce5-72ec-4727-98d9-fe92dc05ef98 req-5fdff90f-5a43-473f-ae1b-9879022cf228 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:41.048214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-17588ce5-72ec-4727-98d9-fe92dc05ef98 req-5fdff90f-5a43-473f-ae1b-9879022cf228 service nova] Creating event network-vif-deleted:f3ff402f-3af5-42df-8ae8-00f340bfd75d for instance fcb371f6-ae21-429b-a7e4-d43500167025 on hv-cinder-81045 Jun 22 17:13:41.055771 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-17588ce5-72ec-4727-98d9-fe92dc05ef98 req-5fdff90f-5a43-473f-ae1b-9879022cf228 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042924 Jun 22 17:13:41.056655 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 504/980] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:41.440624 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:41.441830 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:41.448928 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:41.451252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:41.451252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:41.451252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:41.485221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:41.485665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:41.489612 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lazy-loading 'fault' on Instance uuid fcb371f6-ae21-429b-a7e4-d43500167025 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:13:41.528611 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:41.536009 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0cfa82e8-c1c4-4ba7-96ed-e4e8b317ce4e tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 200 len: 1330 microversion: 2.1 time: 0.099256 Jun 22 17:13:41.536608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 477/981] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:41 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:42.554463 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:42.555196 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:42.561346 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:42.561792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:42.562579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:42.563013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:42.575830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 HTTP/1.1 Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:13:42.577467 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:13:42.579071 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': 'fcb371f6-ae21-429b-a7e4-d43500167025'} Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:13:42.580141 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:13:42.581781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:13:42.583412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:13:42.583412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bdbac91f-ac79-4fed-a9f6-1b8e9d9701d4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 404 len: 111 microversion: 2.1 time: 0.029128 Jun 22 17:13:42.583412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 505/982] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:42 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:13:42.587885 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d0f12521-e5ec-4edc-8289-7e611976a4aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '.version_select at 0x7fe0a030b940>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:42.680746 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d0f12521-e5ec-4edc-8289-7e611976a4aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-828009364" status: 202 len: 0 microversion: 2.1 time: 0.096997 Jun 22 17:13:42.681317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 478/983] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 22 17:13:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-828009364 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:13:43.367278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0c3110c7-b84e-4110-a6a4-1e52e0b8f74b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: .version_select at 0x7fe0a102fc10>, body: {"keypair": {"name": "tempest-keypair-962198864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpjK1yGiQdpq5+o6fUB+qTL+qTVE13T9IPMi+MH6ImDGXlZwYnzr6vuKF/uKGACUUKXBpf87ZuHY0Hue88FzM7fmsYmbYxlXCKFpl5lVUFN2JYJ63qxkta4OH0XZBmIqw=="}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:13:43.381588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-0c3110c7-b84e-4110-a6a4-1e52e0b8f74b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for project 069840ebd26e434c861568668776df52. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:13:43.385344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-0c3110c7-b84e-4110-a6a4-1e52e0b8f74b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for user 05951aa9ba2344a994f9fa1aa6fdb3bf and project 069840ebd26e434c861568668776df52. Resources: {'key_pairs'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:13:43.481087 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0c3110c7-b84e-4110-a6a4-1e52e0b8f74b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118130 Jun 22 17:13:43.481609 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 506/984] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:13:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:45.518631 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1890352890", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62ce7501-df82-41e9-98c8-d1402b2e1e32"}], "security_groups": [{"name": "tempest-securitygroup--166310246"}], "key_name": "tempest-keypair-962198864", "user_data": "}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:13:45.769299 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] validate_networks() for [('62ce7501-df82-41e9-98c8-d1402b2e1e32', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:13:46.134268 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:13:46.134728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:13:46.135197 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:13:46.135627 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:13:46.136032 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:13:46.144821 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:46.145264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:46.146054 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:46.146489 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:46.163288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for project 069840ebd26e434c861568668776df52. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:13:46.167431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for user 05951aa9ba2344a994f9fa1aa6fdb3bf and project 069840ebd26e434c861568668776df52. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:13:46.178825 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:13:46.181119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:13:46.293061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-37bdc9c3-7317-4623-af5e-4cdfa7f8362d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.779088 Jun 22 17:13:46.293634 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 479/985] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:13:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:13:46.304337 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5709db6c-0416-4a7c-a09b-3e0252554fde tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:46.304954 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5709db6c-0416-4a7c-a09b-3e0252554fde tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:46.359186 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5709db6c-0416-4a7c-a09b-3e0252554fde tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:46.367049 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5709db6c-0416-4a7c-a09b-3e0252554fde tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1241 microversion: 2.1 time: 0.067302 Jun 22 17:13:46.367617 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 507/986] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:46 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:47.384069 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-deb0854d-9965-4ac8-ae30-5258362fff9a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:47.386258 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-deb0854d-9965-4ac8-ae30-5258362fff9a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:47.391418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-deb0854d-9965-4ac8-ae30-5258362fff9a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:47.391861 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-deb0854d-9965-4ac8-ae30-5258362fff9a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:47.392656 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-deb0854d-9965-4ac8-ae30-5258362fff9a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:47.393085 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-deb0854d-9965-4ac8-ae30-5258362fff9a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:47.454022 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-deb0854d-9965-4ac8-ae30-5258362fff9a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:47.461317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-deb0854d-9965-4ac8-ae30-5258362fff9a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1237 microversion: 2.1 time: 0.081184 Jun 22 17:13:47.461869 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 480/987] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:47 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:48.478008 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-df68bbd3-5c2e-45f5-b960-6bc6cd094e76 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:48.478623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-df68bbd3-5c2e-45f5-b960-6bc6cd094e76 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:48.485252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-df68bbd3-5c2e-45f5-b960-6bc6cd094e76 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:48.485700 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-df68bbd3-5c2e-45f5-b960-6bc6cd094e76 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:48.486470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-df68bbd3-5c2e-45f5-b960-6bc6cd094e76 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:48.486904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-df68bbd3-5c2e-45f5-b960-6bc6cd094e76 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:48.552252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-df68bbd3-5c2e-45f5-b960-6bc6cd094e76 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:48.560129 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-df68bbd3-5c2e-45f5-b960-6bc6cd094e76 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1299 microversion: 2.1 time: 0.086011 Jun 22 17:13:48.561017 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 508/988] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:48 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:49.577904 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-301acbe7-b20e-415d-8d60-f427ce45206b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:49.579184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-301acbe7-b20e-415d-8d60-f427ce45206b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:49.587417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-301acbe7-b20e-415d-8d60-f427ce45206b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:49.587905 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-301acbe7-b20e-415d-8d60-f427ce45206b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:49.588707 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-301acbe7-b20e-415d-8d60-f427ce45206b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:49.589137 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-301acbe7-b20e-415d-8d60-f427ce45206b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:49.782591 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-301acbe7-b20e-415d-8d60-f427ce45206b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:49.790608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-301acbe7-b20e-415d-8d60-f427ce45206b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1366 microversion: 2.1 time: 0.217193 Jun 22 17:13:49.791167 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 481/989] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:49 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:49.958498 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-05e6a6d1-9c89-4f29-97b8-b547db789d5b req-0b55f355-0b0d-4d00-9213-fa590d0e1cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13", "tag": "8ed3aa4a-4899-4835-8a20-9b65c4106aa4"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:13:49.968306 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-05e6a6d1-9c89-4f29-97b8-b547db789d5b req-0b55f355-0b0d-4d00-9213-fa590d0e1cce service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:49.969208 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-05e6a6d1-9c89-4f29-97b8-b547db789d5b req-0b55f355-0b0d-4d00-9213-fa590d0e1cce service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:49.983448 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-05e6a6d1-9c89-4f29-97b8-b547db789d5b req-0b55f355-0b0d-4d00-9213-fa590d0e1cce service nova] Creating event network-changed:8ed3aa4a-4899-4835-8a20-9b65c4106aa4 for instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 on hv-cinder-81045 Jun 22 17:13:49.988448 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-05e6a6d1-9c89-4f29-97b8-b547db789d5b req-0b55f355-0b0d-4d00-9213-fa590d0e1cce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034593 Jun 22 17:13:49.990052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 509/990] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:50.807713 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7fc2206b-1bc0-4483-9e05-deefc35e0171 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:50.808348 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7fc2206b-1bc0-4483-9e05-deefc35e0171 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:50.814871 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fc2206b-1bc0-4483-9e05-deefc35e0171 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:50.815317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fc2206b-1bc0-4483-9e05-deefc35e0171 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:50.816072 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fc2206b-1bc0-4483-9e05-deefc35e0171 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:50.816597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fc2206b-1bc0-4483-9e05-deefc35e0171 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:50.949558 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7fc2206b-1bc0-4483-9e05-deefc35e0171 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:50.956850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7fc2206b-1bc0-4483-9e05-deefc35e0171 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1366 microversion: 2.1 time: 0.153258 Jun 22 17:13:50.957431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 482/991] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:50 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:51.975165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c0699fbf-1651-4dc7-91d1-222033dc6d67 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:51.975792 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c0699fbf-1651-4dc7-91d1-222033dc6d67 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:51.981920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c0699fbf-1651-4dc7-91d1-222033dc6d67 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:51.982394 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c0699fbf-1651-4dc7-91d1-222033dc6d67 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:51.983166 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c0699fbf-1651-4dc7-91d1-222033dc6d67 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:51.983596 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c0699fbf-1651-4dc7-91d1-222033dc6d67 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:52.185234 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c0699fbf-1651-4dc7-91d1-222033dc6d67 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:52.194615 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c0699fbf-1651-4dc7-91d1-222033dc6d67 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1366 microversion: 2.1 time: 0.222079 Jun 22 17:13:52.194615 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 510/992] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:51 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:53.209853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b284bf7d-b8cd-4343-b718-8d9da51adb6f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:53.210390 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b284bf7d-b8cd-4343-b718-8d9da51adb6f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:53.216881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b284bf7d-b8cd-4343-b718-8d9da51adb6f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:53.217330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b284bf7d-b8cd-4343-b718-8d9da51adb6f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:53.218090 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b284bf7d-b8cd-4343-b718-8d9da51adb6f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:53.218524 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b284bf7d-b8cd-4343-b718-8d9da51adb6f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:53.397554 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b284bf7d-b8cd-4343-b718-8d9da51adb6f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:53.404892 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b284bf7d-b8cd-4343-b718-8d9da51adb6f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1366 microversion: 2.1 time: 0.199044 Jun 22 17:13:53.405440 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 483/993] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:53 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:54.422316 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d1b914d7-d591-46d1-b7ee-cc84f0693e8c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:54.422965 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d1b914d7-d591-46d1-b7ee-cc84f0693e8c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:54.430064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1b914d7-d591-46d1-b7ee-cc84f0693e8c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:54.430510 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1b914d7-d591-46d1-b7ee-cc84f0693e8c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:54.431272 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1b914d7-d591-46d1-b7ee-cc84f0693e8c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:54.431708 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d1b914d7-d591-46d1-b7ee-cc84f0693e8c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:54.558705 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d1b914d7-d591-46d1-b7ee-cc84f0693e8c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:54.566018 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d1b914d7-d591-46d1-b7ee-cc84f0693e8c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1366 microversion: 2.1 time: 0.147583 Jun 22 17:13:54.566571 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 511/994] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:54 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:55.582705 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c75fa02c-167b-47e9-9e0a-cb55e35d09de tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:55.583316 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c75fa02c-167b-47e9-9e0a-cb55e35d09de tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:55.590037 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c75fa02c-167b-47e9-9e0a-cb55e35d09de tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:55.590490 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c75fa02c-167b-47e9-9e0a-cb55e35d09de tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:55.591247 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c75fa02c-167b-47e9-9e0a-cb55e35d09de tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:55.591681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c75fa02c-167b-47e9-9e0a-cb55e35d09de tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:55.716426 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c75fa02c-167b-47e9-9e0a-cb55e35d09de tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:55.723704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c75fa02c-167b-47e9-9e0a-cb55e35d09de tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1366 microversion: 2.1 time: 0.144850 Jun 22 17:13:55.724326 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 484/995] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:55 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:56.262437 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-52248088-77fb-4f24-bd5c-c5a0f28c4c95 req-da5073f1-a07f-4f09-add8-e4403f723a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13", "name": "network-vif-plugged", "status": "completed", "tag": "8ed3aa4a-4899-4835-8a20-9b65c4106aa4"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:13:56.270831 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-52248088-77fb-4f24-bd5c-c5a0f28c4c95 req-da5073f1-a07f-4f09-add8-e4403f723a07 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:56.271254 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-52248088-77fb-4f24-bd5c-c5a0f28c4c95 req-da5073f1-a07f-4f09-add8-e4403f723a07 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:56.283825 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-52248088-77fb-4f24-bd5c-c5a0f28c4c95 req-da5073f1-a07f-4f09-add8-e4403f723a07 service nova] Creating event network-vif-plugged:8ed3aa4a-4899-4835-8a20-9b65c4106aa4 for instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 on hv-cinder-81045 Jun 22 17:13:56.289121 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-52248088-77fb-4f24-bd5c-c5a0f28c4c95 req-da5073f1-a07f-4f09-add8-e4403f723a07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030385 Jun 22 17:13:56.289683 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 512/996] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:13:56.739563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-986e5d1e-ff12-4083-8945-46b2a63c62d6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:56.740204 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-986e5d1e-ff12-4083-8945-46b2a63c62d6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:56.742039 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:56.742694 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:56.747958 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-986e5d1e-ff12-4083-8945-46b2a63c62d6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:56.748462 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-986e5d1e-ff12-4083-8945-46b2a63c62d6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:56.750017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-986e5d1e-ff12-4083-8945-46b2a63c62d6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:56.750017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-986e5d1e-ff12-4083-8945-46b2a63c62d6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:56.880608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-986e5d1e-ff12-4083-8945-46b2a63c62d6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:56.888000 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-986e5d1e-ff12-4083-8945-46b2a63c62d6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1366 microversion: 2.1 time: 0.152455 Jun 22 17:13:56.888630 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 485/997] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:56 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:57.902595 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:57.907260 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-709ea578-c1b3-488a-a47e-ce21a0076e49 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:57.907946 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-709ea578-c1b3-488a-a47e-ce21a0076e49 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:57.914684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-709ea578-c1b3-488a-a47e-ce21a0076e49 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:57.915134 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-709ea578-c1b3-488a-a47e-ce21a0076e49 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:57.915883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-709ea578-c1b3-488a-a47e-ce21a0076e49 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:57.916346 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-709ea578-c1b3-488a-a47e-ce21a0076e49 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:58.047326 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-709ea578-c1b3-488a-a47e-ce21a0076e49 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:58.050761 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:58.055753 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-709ea578-c1b3-488a-a47e-ce21a0076e49 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1366 microversion: 2.1 time: 0.154067 Jun 22 17:13:58.056340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 513/998] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:57 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:59.072765 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7aef8767-784f-42b3-9f06-c0586a77cfa4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:59.073372 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7aef8767-784f-42b3-9f06-c0586a77cfa4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:59.079798 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7aef8767-784f-42b3-9f06-c0586a77cfa4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:59.080287 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7aef8767-784f-42b3-9f06-c0586a77cfa4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:59.081039 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7aef8767-784f-42b3-9f06-c0586a77cfa4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:59.081470 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7aef8767-784f-42b3-9f06-c0586a77cfa4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:59.099410 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:59.211462 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7aef8767-784f-42b3-9f06-c0586a77cfa4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:13:59.218766 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7aef8767-784f-42b3-9f06-c0586a77cfa4 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1555 microversion: 2.1 time: 0.150418 Jun 22 17:13:59.219314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 486/999] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:13:59 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:13:59.236452 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e8c36b44-cab7-4bfa-9107-e3b788c66ab9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:13:59.237061 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e8c36b44-cab7-4bfa-9107-e3b788c66ab9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:13:59.239264 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:59.245603 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e8c36b44-cab7-4bfa-9107-e3b788c66ab9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:59.246162 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e8c36b44-cab7-4bfa-9107-e3b788c66ab9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:59.247082 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e8c36b44-cab7-4bfa-9107-e3b788c66ab9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:13:59.247510 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e8c36b44-cab7-4bfa-9107-e3b788c66ab9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:13:59.326634 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e8c36b44-cab7-4bfa-9107-e3b788c66ab9 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095723 Jun 22 17:13:59.327217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 514/1000] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 17:13:59 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:00.060924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:14:00.060924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:14:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:14:00.303261 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-b5f12310-012d-45eb-804f-7dc10243c946 req-7ee6c96a-1efd-464a-aeff-f4a10ec54e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13", "tag": "8ed3aa4a-4899-4835-8a20-9b65c4106aa4"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:14:00.309289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:00.313184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b5f12310-012d-45eb-804f-7dc10243c946 req-7ee6c96a-1efd-464a-aeff-f4a10ec54e83 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:00.313560 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b5f12310-012d-45eb-804f-7dc10243c946 req-7ee6c96a-1efd-464a-aeff-f4a10ec54e83 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:00.326689 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-b5f12310-012d-45eb-804f-7dc10243c946 req-7ee6c96a-1efd-464a-aeff-f4a10ec54e83 service nova] Creating event network-changed:8ed3aa4a-4899-4835-8a20-9b65c4106aa4 for instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 on hv-cinder-81045 Jun 22 17:14:00.332523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-b5f12310-012d-45eb-804f-7dc10243c946 req-7ee6c96a-1efd-464a-aeff-f4a10ec54e83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032634 Jun 22 17:14:00.333112 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 487/1001] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:05.154147 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-08fcb0c2-db7a-4d59-b218-59a8d22b04f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:05.154996 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-08fcb0c2-db7a-4d59-b218-59a8d22b04f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:05.162165 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-08fcb0c2-db7a-4d59-b218-59a8d22b04f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:05.163314 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-08fcb0c2-db7a-4d59-b218-59a8d22b04f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:05.164050 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-08fcb0c2-db7a-4d59-b218-59a8d22b04f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:05.164512 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-08fcb0c2-db7a-4d59-b218-59a8d22b04f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:05.193262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-08fcb0c2-db7a-4d59-b218-59a8d22b04f8 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044540 Jun 22 17:14:05.193810 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 515/1002] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 22 17:14:05 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:14:05.252349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-64a6f3ad-030e-4b89-ae3f-f90055c9964d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:05.254301 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-64a6f3ad-030e-4b89-ae3f-f90055c9964d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:05.259608 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64a6f3ad-030e-4b89-ae3f-f90055c9964d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:05.260242 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64a6f3ad-030e-4b89-ae3f-f90055c9964d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:05.261002 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64a6f3ad-030e-4b89-ae3f-f90055c9964d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:05.261443 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64a6f3ad-030e-4b89-ae3f-f90055c9964d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:05.285994 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-64a6f3ad-030e-4b89-ae3f-f90055c9964d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:14:05.559362 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-64a6f3ad-030e-4b89-ae3f-f90055c9964d tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 204 len: 0 microversion: 2.20 time: 0.311284 Jun 22 17:14:05.559941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 488/1003] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 22 17:14:05 2022] DELETE /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 17:14:05.569281 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:05.570313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:05.576652 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:05.577101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:05.577860 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:05.578292 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:05.705924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:05.713797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:05.715299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:05.716489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5b5042fb-6ba0-4196-9430-080d3406ffd5 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.152217 Jun 22 17:14:05.717052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 516/1004] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:14:05 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:14:06.735420 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:06.736140 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:06.745910 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:06.746367 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:06.747137 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:06.747576 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:06.877349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:06.885630 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:06.887118 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:06.888304 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-670bb59b-9bdb-4263-9a66-1f588b306311 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1721 microversion: 2.20 time: 0.157257 Jun 22 17:14:06.888847 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 489/1005] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:14:06 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 17:14:07.908278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:07.908926 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:07.915670 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:07.916153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:07.916915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:07.917344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:07.987199 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:07.994787 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:07.996298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:07.997491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f2173e92-c5ab-49d2-9f23-b20b063ca6ba tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1654 microversion: 2.20 time: 0.093236 Jun 22 17:14:07.998046 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 517/1006] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:14:07 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1654 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:14:08.215480 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-587c201f-3f0e-4c4b-b3fd-89a905ec20c8 req-70bf0f1e-2580-497d-bc5a-916f31694a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a539c2c-893b-45d9-b3a0-4242b0458c67", "name": "network-vif-deleted", "tag": "fba9e631-9db1-4fcb-b461-46e4f03b9525"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:14:08.227501 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-587c201f-3f0e-4c4b-b3fd-89a905ec20c8 req-70bf0f1e-2580-497d-bc5a-916f31694a35 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:08.227501 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-587c201f-3f0e-4c4b-b3fd-89a905ec20c8 req-70bf0f1e-2580-497d-bc5a-916f31694a35 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:08.235202 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-587c201f-3f0e-4c4b-b3fd-89a905ec20c8 req-70bf0f1e-2580-497d-bc5a-916f31694a35 service nova] Creating event network-vif-deleted:fba9e631-9db1-4fcb-b461-46e4f03b9525 for instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 on hv-cinder-81045 Jun 22 17:14:08.240022 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-587c201f-3f0e-4c4b-b3fd-89a905ec20c8 req-70bf0f1e-2580-497d-bc5a-916f31694a35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028149 Jun 22 17:14:08.241347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 490/1007] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:09.016964 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:09.017615 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:09.025156 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:09.025779 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:09.026630 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:09.027016 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:09.060573 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:09.061027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:09.061482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lazy-loading 'fault' on Instance uuid 9a539c2c-893b-45d9-b3a0-4242b0458c67 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:14:09.108002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:09.117521 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:09.119491 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afd423384efd459babccf3ff34214973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5f63bad73c4a89b604c29290e4143f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:14:09.120809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-17dc4970-f5ea-433c-83e9-c6c8d0e8ed66 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 200 len: 1371 microversion: 2.20 time: 0.108210 Jun 22 17:14:09.121445 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 518/1008] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:14:09 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 17:14:10.139728 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:10.140469 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:10.146638 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:10.147180 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:10.148482 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:10.148931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:10.161655 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] HTTP exception thrown: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Request method failure captured: Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 HTTP/1.1 Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0wpokYbKaw-VU9G_-JdSOJQi3yVnOGqUn-K0c7gU0mixeNcJcHfJOH_Rx55rlQ4cL_dkS-8bLZO_YKcvMeSuYN2D9Ka_Wn-swZ1e0EMeBudmcP85IznUhRogPF9M-WEPLk29cRT0HiN0_oSKo24gMr38ImFjV2pR2xXEUONSLhohh4 Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:14:10.163257 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: afd423384efd459babccf3ff34214973 Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:10.164998 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '9a539c2c-893b-45d9-b3a0-4242b0458c67'} Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:10.165942 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:10.167800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:10.169270 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Returning 404 to user: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:10.169270 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2ed7e618-fb0d-44fe-8e91-ee5feefb203a tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 404 len: 111 microversion: 2.20 time: 0.029694 Jun 22 17:14:10.169270 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 491/1009] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:14:10 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 17:14:10.173798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7e168ade-a26c-4f7e-a2ac-917ee8291ce7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '.version_select at 0x7fe0a0e6fdc0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:10.251599 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7e168ade-a26c-4f7e-a2ac-917ee8291ce7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337968557" status: 204 len: 0 microversion: 2.20 time: 0.081532 Jun 22 17:14:10.252201 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 519/1010] 10.222.0.18 () {60 vars in 1258 bytes} [Wed Jun 22 17:14:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337968557 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 17:14:12.558308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:12.558803 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:12.565181 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:12.565621 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:12.566374 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:12.566805 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:12.582838 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] HTTP exception thrown: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Request method failure captured: Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 HTTP/1.1 Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0wpokYbKaw-VU9G_-JdSOJQi3yVnOGqUn-K0c7gU0mixeNcJcHfJOH_Rx55rlQ4cL_dkS-8bLZO_YKcvMeSuYN2D9Ka_Wn-swZ1e0EMeBudmcP85IznUhRogPF9M-WEPLk29cRT0HiN0_oSKo24gMr38ImFjV2pR2xXEUONSLhohh4 Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:14:12.584391 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: afd423384efd459babccf3ff34214973 Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.586122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '9a539c2c-893b-45d9-b3a0-4242b0458c67'} Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:12.587025 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.588300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.589583 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Returning 404 to user: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:12.589583 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7406fb3e-2ad6-4483-bfa7-06ee7c730236 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 404 len: 111 microversion: 2.20 time: 0.031818 Jun 22 17:14:12.589583 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 492/1011] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 22 17:14:12 2022] DELETE /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 17:14:12.593972 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:12.594584 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 9a539c2c-893b-45d9-b3a0-4242b0458c67] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:12.601648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:12.602097 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:12.602857 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:12.603291 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:12.615983 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] HTTP exception thrown: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Request method failure captured: Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 HTTP/1.1 Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0wpokYbKaw-VU9G_-JdSOJQi3yVnOGqUn-K0c7gU0mixeNcJcHfJOH_Rx55rlQ4cL_dkS-8bLZO_YKcvMeSuYN2D9Ka_Wn-swZ1e0EMeBudmcP85IznUhRogPF9M-WEPLk29cRT0HiN0_oSKo24gMr38ImFjV2pR2xXEUONSLhohh4 Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:14:12.618144 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: afd423384efd459babccf3ff34214973 Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.619842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '9a539c2c-893b-45d9-b3a0-4242b0458c67'} Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:12.620918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. Jun 22 17:14:12.622487 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:12.623839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Returning 404 to user: Instance 9a539c2c-893b-45d9-b3a0-4242b0458c67 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:12.623839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f99dba74-8cd3-436d-8993-c9636d32c1d7 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67" status: 404 len: 111 microversion: 2.20 time: 0.029377 Jun 22 17:14:12.623839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 520/1012] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:14:12 2022] GET /compute/v2.1/servers/9a539c2c-893b-45d9-b3a0-4242b0458c67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 17:14:13.851208 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:13.851714 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:13.858331 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:13.858781 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:13.859573 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:13.860010 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:13.872930 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] HTTP exception thrown: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Request method failure captured: Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 HTTP/1.1 Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0wpokYbKaw-VU9G_-JdSOJQi3yVnOGqUn-K0c7gU0mixeNcJcHfJOH_Rx55rlQ4cL_dkS-8bLZO_YKcvMeSuYN2D9Ka_Wn-swZ1e0EMeBudmcP85IznUhRogPF9M-WEPLk29cRT0HiN0_oSKo24gMr38ImFjV2pR2xXEUONSLhohh4 Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:14:13.874453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: afd423384efd459babccf3ff34214973 Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.876094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '78bb9410-a261-4625-ae42-6fe5e09a8d75'} Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:13.877006 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.878601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.880246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Returning 404 to user: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:13.880246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-59a92bab-b77f-483c-92d1-825439762f74 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "DELETE /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 404 len: 111 microversion: 2.20 time: 0.028668 Jun 22 17:14:13.880246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 493/1013] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 22 17:14:13 2022] DELETE /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 17:14:13.884873 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:13.885482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] [instance: 78bb9410-a261-4625-ae42-6fe5e09a8d75] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:14:13.891843 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:13.892350 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:13.893107 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:14:13.893532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:14:13.908909 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] HTTP exception thrown: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Request method failure captured: Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 HTTP/1.1 Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0wpokYbKaw-VU9G_-JdSOJQi3yVnOGqUn-K0c7gU0mixeNcJcHfJOH_Rx55rlQ4cL_dkS-8bLZO_YKcvMeSuYN2D9Ka_Wn-swZ1e0EMeBudmcP85IznUhRogPF9M-WEPLk29cRT0HiN0_oSKo24gMr38ImFjV2pR2xXEUONSLhohh4 Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:14:13.910409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8d5f63bad73c4a89b604c29290e4143f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 8d5f63bad73c4a89b604c29290e4143f Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72309931 Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: afd423384efd459babccf3ff34214973 Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72309931-project Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.912247 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '78bb9410-a261-4625-ae42-6fe5e09a8d75'} Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:13.913231 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. Jun 22 17:14:13.914808 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:13.916191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] Returning 404 to user: Instance 78bb9410-a261-4625-ae42-6fe5e09a8d75 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:13.916191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8a4ed81d-5e98-4184-a1f0-2454d8acf545 tempest-AttachVolumeShelveTestJSON-72309931 tempest-AttachVolumeShelveTestJSON-72309931-project] 10.222.0.18 "GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75" status: 404 len: 111 microversion: 2.20 time: 0.032137 Jun 22 17:14:13.916191 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 521/1014] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 17:14:13 2022] GET /compute/v2.1/servers/78bb9410-a261-4625-ae42-6fe5e09a8d75 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 17:14:19.177595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d2dd0b67-9cdc-455f-87fa-3a6d9f05322d tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Action: 'create', calling method: .version_select at 0x7fe0a037a9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-483193716"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:14:19.689751 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d2dd0b67-9cdc-455f-87fa-3a6d9f05322d tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.624725 Jun 22 17:14:19.690296 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 494/1015] 10.222.0.18 () {60 vars in 1154 bytes} [Wed Jun 22 17:14:19 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 626 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 17:14:19.701392 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-34576ad7-a3be-435c-8ed8-2153e28cbc24 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0473310>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:19.751374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-34576ad7-a3be-435c-8ed8-2153e28cbc24 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540" status: 200 len: 344 microversion: 2.1 time: 0.053757 Jun 22 17:14:19.751932 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 522/1016] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 17:14:19 2022] GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:20.764856 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-28cfa125-252e-4940-a401-e7614c25deb3 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a03525e0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:20.811921 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-28cfa125-252e-4940-a401-e7614c25deb3 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540" status: 200 len: 345 microversion: 2.1 time: 0.051308 Jun 22 17:14:20.812503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 495/1017] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 17:14:20 2022] GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:20.825624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e3cb9071-d7c1-42c6-85c7-871495781cd4 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Action: 'create', calling method: .version_select at 0x7fe0a0e3ee50>, body: {"snapshot": {"volume_id": "84b27189-d9d0-414e-8c19-66a7680ad540", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1203349970"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:14:21.270172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e3cb9071-d7c1-42c6-85c7-871495781cd4 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.450208 Jun 22 17:14:21.270717 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 523/1018] 10.222.0.18 () {60 vars in 1161 bytes} [Wed Jun 22 17:14:20 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:21.281013 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-742ffafb-9bd7-43a5-82fd-e163caf3b780 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a043bc10>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:21.310229 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-742ffafb-9bd7-43a5-82fd-e163caf3b780 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 200 len: 287 microversion: 2.1 time: 0.032859 Jun 22 17:14:21.310774 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 496/1019] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:21 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:21.320125 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cf987449-f0e3-40f5-bc4a-d32ae15317c5 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0473c10>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:21.353311 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cf987449-f0e3-40f5-bc4a-d32ae15317c5 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036858 Jun 22 17:14:21.360314 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 524/1020] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Jun 22 17:14:21 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:21.365144 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-58f1af61-47a0-494b-b2fd-741fd8b0003f tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0428940>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:21.395940 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-58f1af61-47a0-494b-b2fd-741fd8b0003f tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 200 len: 287 microversion: 2.1 time: 0.034829 Jun 22 17:14:21.396535 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 497/1021] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:21 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:22.408289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4443c78b-399b-4ff4-8e20-b94c67f2d47e tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0e6fd30>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:22.437699 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4443c78b-399b-4ff4-8e20-b94c67f2d47e tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 200 len: 287 microversion: 2.1 time: 0.033723 Jun 22 17:14:22.438295 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 525/1022] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:22 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:23.450393 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c039f77a-04c3-4092-af89-c05cbcf56d68 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0352940>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:23.479187 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c039f77a-04c3-4092-af89-c05cbcf56d68 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 200 len: 287 microversion: 2.1 time: 0.033567 Jun 22 17:14:23.479724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 498/1023] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:23 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:24.487892 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:24.488677 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=34 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:24.492412 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-af4a668e-9174-488d-bf17-3fdf7ee23100 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0fdfdc0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:24.521218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-af4a668e-9174-488d-bf17-3fdf7ee23100 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 200 len: 287 microversion: 2.1 time: 0.034456 Jun 22 17:14:24.521762 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 526/1024] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:24 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:25.530218 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:25.530904 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:25.535280 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a7afb5cb-2203-4452-82b7-53e2a6a7f636 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0428d30>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:25.567114 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a7afb5cb-2203-4452-82b7-53e2a6a7f636 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 200 len: 287 microversion: 2.1 time: 0.034427 Jun 22 17:14:25.567114 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 499/1025] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:25 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:14:26.576462 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b9e82cc8-27b6-4b29-b21e-b22e36748ccb tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0f8fca0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:26.605526 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b9e82cc8-27b6-4b29-b21e-b22e36748ccb tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 200 len: 288 microversion: 2.1 time: 0.033212 Jun 22 17:14:26.606080 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 527/1026] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:26 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:26.616672 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-19d295ed-03ee-42ce-b2e1-52cefb9fe1c5 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a030b160>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:26.748003 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-19d295ed-03ee-42ce-b2e1-52cefb9fe1c5 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 202 len: 0 microversion: 2.1 time: 0.135824 Jun 22 17:14:26.748596 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 500/1027] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Jun 22 17:14:26 2022] DELETE /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:14:26.757066 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-6922d436-cec1-4b6d-911d-bd5bd24f828a tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0e59280>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:26.786386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-6922d436-cec1-4b6d-911d-bd5bd24f828a tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 200 len: 287 microversion: 2.1 time: 0.033129 Jun 22 17:14:26.786937 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 528/1028] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:26 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:14:27.798780 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b3ae69a2-0df5-4dc5-9056-579d67cbb4be tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a04284c0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-b3ae69a2-0df5-4dc5-9056-579d67cbb4be tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] HTTP exception thrown: Snapshot ea907c0e-a475-4527-8cb8-b26c4bcb0d73 could not be found. Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b3ae69a2-0df5-4dc5-9056-579d67cbb4be tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Request method failure captured: Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 HTTP/1.1 Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis03qm5rFVWOOwYDJrKGiY0IbxZv3K6nKeFotnUpPxmH1Eh5Zs8Lh1HjGZZ9XiSm144_kv0i2CAPdmyibM0taj8WVsCZkGhUNy_0alxWg1SdFZbp67wHp62vQcYBaWue_sxxPO-VapVZMs_yY3ScDjDxiqXLeFJzKlDCuyXH_glv8wyg Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 619d0b5681cd441dbb28042b0cb8bf46 Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:14:27.826710 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 619d0b5681cd441dbb28042b0cb8bf46 Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesSnapshotsTestJSON-2129861531-project Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 4fbee68a3587459b89081c9453b0fc2c Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2129861531-project Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Snapshot ea907c0e-a475-4527-8cb8-b26c4bcb0d73 could not be found. Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': 'ea907c0e-a475-4527-8cb8-b26c4bcb0d73'} Jun 22 17:14:27.828307 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ea907c0e-a475-4527-8cb8-b26c4bcb0d73 could not be found. (HTTP 404) (Request-ID: req-98bc374d-e61d-458d-8787-643752a660df) Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:27.829329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 17:14:27.831099 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ea907c0e-a475-4527-8cb8-b26c4bcb0d73 could not be found. Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 17:14:27.832642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ea907c0e-a475-4527-8cb8-b26c4bcb0d73 could not be found. Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ea907c0e-a475-4527-8cb8-b26c4bcb0d73 could not be found. Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b3ae69a2-0df5-4dc5-9056-579d67cbb4be tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Returning 404 to user: Snapshot ea907c0e-a475-4527-8cb8-b26c4bcb0d73 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:27.834145 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b3ae69a2-0df5-4dc5-9056-579d67cbb4be tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73" status: 404 len: 111 microversion: 2.1 time: 0.032762 Jun 22 17:14:27.835115 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 501/1029] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 17:14:27 2022] GET /compute/v2.1/os-snapshots/ea907c0e-a475-4527-8cb8-b26c4bcb0d73 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:14:27.836213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8d8eac58-7a81-453e-8b8d-80e54fbb12dc tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0fdf670>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:28.046068 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8d8eac58-7a81-453e-8b8d-80e54fbb12dc tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540" status: 202 len: 0 microversion: 2.1 time: 0.214040 Jun 22 17:14:28.046714 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 529/1030] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 17:14:27 2022] DELETE /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:14:28.054981 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-223e96cb-7a0b-43df-97de-9e0d844bbf71 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a03afee0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:28.101501 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-223e96cb-7a0b-43df-97de-9e0d844bbf71 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540" status: 200 len: 344 microversion: 2.1 time: 0.050307 Jun 22 17:14:28.102047 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 502/1031] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 17:14:28 2022] GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:29.114603 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-98aa7fb0-1869-4e3b-b9a0-cb87c193746a tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0e59dc0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:29.142023 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-98aa7fb0-1869-4e3b-b9a0-cb87c193746a tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] HTTP exception thrown: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-98aa7fb0-1869-4e3b-b9a0-cb87c193746a tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Request method failure captured: Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 HTTP/1.1 Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis03qm5rFVWOOwYDJrKGiY0IbxZv3K6nKeFotnUpPxmH1Eh5Zs8Lh1HjGZZ9XiSm144_kv0i2CAPdmyibM0taj8WVsCZkGhUNy_0alxWg1SdFZbp67wHp62vQcYBaWue_sxxPO-VapVZMs_yY3ScDjDxiqXLeFJzKlDCuyXH_glv8wyg Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 619d0b5681cd441dbb28042b0cb8bf46 Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:14:29.143995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 619d0b5681cd441dbb28042b0cb8bf46 Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesSnapshotsTestJSON-2129861531-project Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 4fbee68a3587459b89081c9453b0fc2c Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2129861531-project Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '84b27189-d9d0-414e-8c19-66a7680ad540'} Jun 22 17:14:29.145662 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. (HTTP 404) (Request-ID: req-b0a160a0-0127-4b01-a5d8-da06122ce316) Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.146824 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 17:14:29.148302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 17:14:29.149995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-98aa7fb0-1869-4e3b-b9a0-cb87c193746a tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Returning 404 to user: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-98aa7fb0-1869-4e3b-b9a0-cb87c193746a tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540" status: 404 len: 109 microversion: 2.1 time: 0.035112 Jun 22 17:14:29.151341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 530/1032] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 17:14:29 2022] GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:14:29.155367 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-db32707c-603b-4242-baad-3a856ed0e571 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a040bc10>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:29.183503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-db32707c-603b-4242-baad-3a856ed0e571 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] HTTP exception thrown: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-db32707c-603b-4242-baad-3a856ed0e571 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Request method failure captured: Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 HTTP/1.1 Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis03qm5rFVWOOwYDJrKGiY0IbxZv3K6nKeFotnUpPxmH1Eh5Zs8Lh1HjGZZ9XiSm144_kv0i2CAPdmyibM0taj8WVsCZkGhUNy_0alxWg1SdFZbp67wHp62vQcYBaWue_sxxPO-VapVZMs_yY3ScDjDxiqXLeFJzKlDCuyXH_glv8wyg Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 619d0b5681cd441dbb28042b0cb8bf46 Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:14:29.186209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 619d0b5681cd441dbb28042b0cb8bf46 Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesSnapshotsTestJSON-2129861531-project Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 4fbee68a3587459b89081c9453b0fc2c Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2129861531-project Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '84b27189-d9d0-414e-8c19-66a7680ad540'} Jun 22 17:14:29.187839 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. (HTTP 404) (Request-ID: req-f03a287e-e4ec-4d06-9ce4-3c602242acbb) Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.188887 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 17:14:29.190091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 17:14:29.191288 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-db32707c-603b-4242-baad-3a856ed0e571 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Returning 404 to user: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:29.192696 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-db32707c-603b-4242-baad-3a856ed0e571 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540" status: 404 len: 109 microversion: 2.1 time: 0.036672 Jun 22 17:14:29.193747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 503/1033] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 17:14:29 2022] DELETE /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:14:29.196556 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f994b6a6-a33f-42d6-a137-26aaa0eeb690 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Calling method '.version_select at 0x7fe0a0e6fc10>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:29.223430 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-f994b6a6-a33f-42d6-a137-26aaa0eeb690 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] HTTP exception thrown: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f994b6a6-a33f-42d6-a137-26aaa0eeb690 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Request method failure captured: Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 HTTP/1.1 Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis03qm5rFVWOOwYDJrKGiY0IbxZv3K6nKeFotnUpPxmH1Eh5Zs8Lh1HjGZZ9XiSm144_kv0i2CAPdmyibM0taj8WVsCZkGhUNy_0alxWg1SdFZbp67wHp62vQcYBaWue_sxxPO-VapVZMs_yY3ScDjDxiqXLeFJzKlDCuyXH_glv8wyg Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 619d0b5681cd441dbb28042b0cb8bf46 Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:14:29.225421 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/619d0b5681cd441dbb28042b0cb8bf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 619d0b5681cd441dbb28042b0cb8bf46 Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2129861531 Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-VolumesSnapshotsTestJSON-2129861531-project Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 4fbee68a3587459b89081c9453b0fc2c Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2129861531-project Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '84b27189-d9d0-414e-8c19-66a7680ad540'} Jun 22 17:14:29.227093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. (HTTP 404) (Request-ID: req-51623e9f-00ab-4d0c-b967-f630058e495f) Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.228117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 17:14:29.229544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 17:14:29.231515 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f994b6a6-a33f-42d6-a137-26aaa0eeb690 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] Returning 404 to user: Volume 84b27189-d9d0-414e-8c19-66a7680ad540 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f994b6a6-a33f-42d6-a137-26aaa0eeb690 tempest-VolumesSnapshotsTestJSON-2129861531 tempest-VolumesSnapshotsTestJSON-2129861531-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540" status: 404 len: 109 microversion: 2.1 time: 0.034031 Jun 22 17:14:29.232969 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 531/1034] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 17:14:29 2022] GET /compute/v2.1/os-volumes/84b27189-d9d0-414e-8c19-66a7680ad540 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:14:32.916781 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-04ce5d87-41dc-4a8d-8c5e-cd463759e1fc tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a0415e50>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:32.964650 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-04ce5d87-41dc-4a8d-8c5e-cd463759e1fc tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c11b1176-2c29-43ef-b8fa-4e387f46adc2" status: 200 len: 351 microversion: 2.1 time: 0.051497 Jun 22 17:14:32.965201 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 504/1035] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 17:14:32 2022] GET /compute/v2.1/os-volumes/c11b1176-2c29-43ef-b8fa-4e387f46adc2 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:34.558169 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-cba7df43-93a3-4f87-b1d9-d5c6e5f631e3 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a0e59b80>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:34.604117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-cba7df43-93a3-4f87-b1d9-d5c6e5f631e3 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6a345085-02d1-4410-9ad5-933246881eb8" status: 200 len: 351 microversion: 2.1 time: 0.050251 Jun 22 17:14:34.604763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 532/1036] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 17:14:34 2022] GET /compute/v2.1/os-volumes/6a345085-02d1-4410-9ad5-933246881eb8 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:36.194665 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1002910b-5163-4afd-a10f-894559b1f159 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a04159d0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.245989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1002910b-5163-4afd-a10f-894559b1f159 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/08259a76-d409-4e3e-a2cb-b87e36b1af92" status: 200 len: 349 microversion: 2.1 time: 0.049868 Jun 22 17:14:36.245989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 505/1037] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes/08259a76-d409-4e3e-a2cb-b87e36b1af92 => generated 349 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:36.253260 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-de626718-139f-42ad-92c6-f0b80c6ea6c7 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a0e115e0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.332417 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-de626718-139f-42ad-92c6-f0b80c6ea6c7 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083287 Jun 22 17:14:36.332977 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 533/1038] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:14:36.345329 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1c0a21c2-ecae-4295-9c71-a1aaa019c295 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a04158b0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.425954 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1c0a21c2-ecae-4295-9c71-a1aaa019c295 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084256 Jun 22 17:14:36.426509 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 506/1039] 10.222.0.18 () {58 vars in 1148 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:36.438248 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-93c4aa22-e10f-42c6-b5c7-25354bf5e39f tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a0e2ee50>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.517131 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-93c4aa22-e10f-42c6-b5c7-25354bf5e39f tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082631 Jun 22 17:14:36.517696 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 534/1040] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:14:36.529239 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-14b98c6d-0080-48ed-9c7b-bba8a324781c tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a0466f70>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.616042 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-14b98c6d-0080-48ed-9c7b-bba8a324781c tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091017 Jun 22 17:14:36.616627 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 507/1041] 10.222.0.18 () {58 vars in 1166 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:36.628250 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-396a073a-ec3d-4f0a-b073-4f5213c2b204 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a0e110d0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.706837 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-396a073a-ec3d-4f0a-b073-4f5213c2b204 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.082462 Jun 22 17:14:36.707406 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 535/1042] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:36.719959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-25787bc2-3ece-4a3b-9d35-2c8d95afc1f4 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a04664c0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.798124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-25787bc2-3ece-4a3b-9d35-2c8d95afc1f4 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082028 Jun 22 17:14:36.798674 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 508/1043] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:14:36.809612 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7e730f61-9022-431f-95be-84f1fb0d0b9e tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a0fdc310>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.890426 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7e730f61-9022-431f-95be-84f1fb0d0b9e tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084476 Jun 22 17:14:36.890983 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 536/1044] 10.222.0.18 () {58 vars in 1187 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:14:36.902370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4b7e238b-8b92-4ff1-83e9-6ec548900892 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] Calling method '.version_select at 0x7fe0a043b550>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:14:36.998689 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4b7e238b-8b92-4ff1-83e9-6ec548900892 tempest-VolumesTestJSON-1679982325 tempest-VolumesTestJSON-1679982325-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.099977 Jun 22 17:14:36.999238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 509/1045] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Jun 22 17:14:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:27.962206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-35f7f18e-c7da-47fe-8eff-989ccdedbe14 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:27.962723 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-35f7f18e-c7da-47fe-8eff-989ccdedbe14 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:27.969693 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-35f7f18e-c7da-47fe-8eff-989ccdedbe14 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:27.972740 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-35f7f18e-c7da-47fe-8eff-989ccdedbe14 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:27.973538 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-35f7f18e-c7da-47fe-8eff-989ccdedbe14 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:27.973985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-35f7f18e-c7da-47fe-8eff-989ccdedbe14 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:27.998892 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-35f7f18e-c7da-47fe-8eff-989ccdedbe14 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/ips" status: 200 len: 149 microversion: 2.1 time: 0.200269 Jun 22 17:15:27.999494 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 537/1046] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 17:15:27 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/ips => generated 149 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:15:29.632274 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-553002e0-23ae-4913-857f-321d2fd1ca84 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fd94139-9a68-418b-b846-b5619d4bbfef"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:15:29.633324 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-553002e0-23ae-4913-857f-321d2fd1ca84 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:29.639865 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-553002e0-23ae-4913-857f-321d2fd1ca84 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:29.640354 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-553002e0-23ae-4913-857f-321d2fd1ca84 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:29.641734 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-553002e0-23ae-4913-857f-321d2fd1ca84 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:29.642910 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-553002e0-23ae-4913-857f-321d2fd1ca84 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:30.488347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-553002e0-23ae-4913-857f-321d2fd1ca84 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860817 Jun 22 17:15:30.488951 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 510/1047] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:15:29 2022] POST /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:15:39.035213 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fd94139-9a68-418b-b846-b5619d4bbfef"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:15:39.036374 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:39.038408 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:15:39.039059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=4 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:15:39.044010 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:39.050710 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:39.050710 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:39.050710 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:39.129864 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Invalid volume: volume 6fd94139-9a68-418b-b846-b5619d4bbfef is already attached to instances: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: POST /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments HTTP/1.1 Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 74 Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:15:39.131484 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {"volumeAttachment": {"volumeId": "6fd94139-9a68-418b-b846-b5619d4bbfef"}} Jun 22 17:15:39.133297 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Invalid volume: volume 6fd94139-9a68-418b-b846-b5619d4bbfef is already attached to instances: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'server_id': '5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13', 'body': {'volumeAttachment': {'volumeId': '6fd94139-9a68-418b-b846-b5619d4bbfef'}}} Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6fd94139-9a68-418b-b846-b5619d4bbfef is already attached to instances: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:15:39.134273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6fd94139-9a68-418b-b846-b5619d4bbfef is already attached to instances: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:15:39.135586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:15:39.137588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:15:39.137588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:15:39.137588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:15:39.137588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6fd94139-9a68-418b-b846-b5619d4bbfef is already attached to instances: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 Jun 22 17:15:39.137588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:15:39.137588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 400 to user: Invalid volume: volume 6fd94139-9a68-418b-b846-b5619d4bbfef is already attached to instances: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:15:39.137588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7111924d-9ca4-4f45-b8b7-b5b605712f91 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102581 Jun 22 17:15:39.137588 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 538/1048] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:15:39 2022] POST /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 17:15:39.198205 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6a152c8c-3185-4184-84a3-7bb6f2a50174 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:39.198786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6a152c8c-3185-4184-84a3-7bb6f2a50174 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:39.204983 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6a152c8c-3185-4184-84a3-7bb6f2a50174 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:39.205430 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6a152c8c-3185-4184-84a3-7bb6f2a50174 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:39.206188 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6a152c8c-3185-4184-84a3-7bb6f2a50174 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:39.206620 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6a152c8c-3185-4184-84a3-7bb6f2a50174 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:39.289767 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-6a152c8c-3185-4184-84a3-7bb6f2a50174 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lazy-loading 'services' on Instance uuid 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:15:39.493736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6a152c8c-3185-4184-84a3-7bb6f2a50174 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments/6fd94139-9a68-418b-b846-b5619d4bbfef" status: 202 len: 0 microversion: 2.1 time: 0.296709 Jun 22 17:15:39.493736 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 511/1049] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:15:39 2022] DELETE /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments/6fd94139-9a68-418b-b846-b5619d4bbfef => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:15:39.501893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1a2ddf2d-607d-4b55-889c-b7418af4c4b8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:39.502817 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1a2ddf2d-607d-4b55-889c-b7418af4c4b8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:39.510433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1a2ddf2d-607d-4b55-889c-b7418af4c4b8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:39.510960 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1a2ddf2d-607d-4b55-889c-b7418af4c4b8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:39.511733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1a2ddf2d-607d-4b55-889c-b7418af4c4b8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:39.512196 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-1a2ddf2d-607d-4b55-889c-b7418af4c4b8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:39.542596 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1a2ddf2d-607d-4b55-889c-b7418af4c4b8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Jun 22 17:15:39.543135 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 539/1050] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:15:39 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:15:40.558752 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-57211675-6681-4a1c-b0d1-bfc11faa175a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:40.559795 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-57211675-6681-4a1c-b0d1-bfc11faa175a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:40.566874 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57211675-6681-4a1c-b0d1-bfc11faa175a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:40.567332 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57211675-6681-4a1c-b0d1-bfc11faa175a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:40.568229 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57211675-6681-4a1c-b0d1-bfc11faa175a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:40.568847 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57211675-6681-4a1c-b0d1-bfc11faa175a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:40.603629 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-57211675-6681-4a1c-b0d1-bfc11faa175a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052378 Jun 22 17:15:40.604213 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 512/1051] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:15:40 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:15:41.615636 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3c6e902f-2cc5-45a1-b0b5-ffc068e22b6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:41.616598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3c6e902f-2cc5-45a1-b0b5-ffc068e22b6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:41.623004 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3c6e902f-2cc5-45a1-b0b5-ffc068e22b6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:41.623450 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3c6e902f-2cc5-45a1-b0b5-ffc068e22b6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:41.624228 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3c6e902f-2cc5-45a1-b0b5-ffc068e22b6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:41.624659 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3c6e902f-2cc5-45a1-b0b5-ffc068e22b6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:41.653002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3c6e902f-2cc5-45a1-b0b5-ffc068e22b6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041883 Jun 22 17:15:41.653547 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 540/1052] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:15:41 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 17:15:41.710112 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3116889f-901c-47db-84cd-809e0aa450a7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:41.710595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3116889f-901c-47db-84cd-809e0aa450a7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:41.717197 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3116889f-901c-47db-84cd-809e0aa450a7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:41.717652 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3116889f-901c-47db-84cd-809e0aa450a7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:41.718431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3116889f-901c-47db-84cd-809e0aa450a7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:41.718862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3116889f-901c-47db-84cd-809e0aa450a7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:41.744766 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3116889f-901c-47db-84cd-809e0aa450a7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:15:41.992937 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3116889f-901c-47db-84cd-809e0aa450a7 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 204 len: 0 microversion: 2.1 time: 0.286180 Jun 22 17:15:41.993481 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 513/1053] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:15:41 2022] DELETE /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:15:42.001529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2f641fe6-a5e4-45c6-bc80-e977d38cff50 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:42.002163 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2f641fe6-a5e4-45c6-bc80-e977d38cff50 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:42.008392 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f641fe6-a5e4-45c6-bc80-e977d38cff50 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:42.008839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f641fe6-a5e4-45c6-bc80-e977d38cff50 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:42.009602 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f641fe6-a5e4-45c6-bc80-e977d38cff50 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:42.010037 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2f641fe6-a5e4-45c6-bc80-e977d38cff50 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:42.146335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2f641fe6-a5e4-45c6-bc80-e977d38cff50 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:42.154172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2f641fe6-a5e4-45c6-bc80-e977d38cff50 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1680 microversion: 2.1 time: 0.156460 Jun 22 17:15:42.154746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 541/1054] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:41 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:43.172956 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7a640a47-ec3c-415f-918a-e87a6d298a06 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:43.173680 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7a640a47-ec3c-415f-918a-e87a6d298a06 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:43.182076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7a640a47-ec3c-415f-918a-e87a6d298a06 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:43.182528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7a640a47-ec3c-415f-918a-e87a6d298a06 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:43.183298 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7a640a47-ec3c-415f-918a-e87a6d298a06 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:43.183804 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7a640a47-ec3c-415f-918a-e87a6d298a06 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:43.318349 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7a640a47-ec3c-415f-918a-e87a6d298a06 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:43.325853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7a640a47-ec3c-415f-918a-e87a6d298a06 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1680 microversion: 2.1 time: 0.157356 Jun 22 17:15:43.326421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 514/1055] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:43 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:44.342878 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-30f0eaf8-ea52-46bd-bc10-e49423e821f8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:44.343589 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-30f0eaf8-ea52-46bd-bc10-e49423e821f8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:44.350390 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-30f0eaf8-ea52-46bd-bc10-e49423e821f8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:44.350921 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-30f0eaf8-ea52-46bd-bc10-e49423e821f8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:44.351701 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-30f0eaf8-ea52-46bd-bc10-e49423e821f8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:44.352161 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-30f0eaf8-ea52-46bd-bc10-e49423e821f8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:44.481232 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-30f0eaf8-ea52-46bd-bc10-e49423e821f8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:44.489368 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-30f0eaf8-ea52-46bd-bc10-e49423e821f8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1680 microversion: 2.1 time: 0.150293 Jun 22 17:15:44.489870 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 542/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:44 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:45.056800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-ec6ec4bb-3b7f-4432-b984-c34b61c5cfdd req-a6ab4d74-6675-4640-871e-852ed477742c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13", "name": "network-vif-deleted", "tag": "8ed3aa4a-4899-4835-8a20-9b65c4106aa4"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:15:45.065510 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ec6ec4bb-3b7f-4432-b984-c34b61c5cfdd req-a6ab4d74-6675-4640-871e-852ed477742c service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:45.066228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ec6ec4bb-3b7f-4432-b984-c34b61c5cfdd req-a6ab4d74-6675-4640-871e-852ed477742c service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:45.078162 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-ec6ec4bb-3b7f-4432-b984-c34b61c5cfdd req-a6ab4d74-6675-4640-871e-852ed477742c service nova] Creating event network-vif-deleted:8ed3aa4a-4899-4835-8a20-9b65c4106aa4 for instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 on hv-cinder-81045 Jun 22 17:15:45.084525 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-ec6ec4bb-3b7f-4432-b984-c34b61c5cfdd req-a6ab4d74-6675-4640-871e-852ed477742c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100491 Jun 22 17:15:45.085120 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 515/1057] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:15:45.506832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:45.507502 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:45.514056 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:45.514563 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:45.515282 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:45.515748 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:45.546335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:45.546798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:45.547252 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lazy-loading 'fault' on Instance uuid 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:15:45.591218 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:45.599396 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f7ac376c-c934-4d6e-9940-2419324de984 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 200 len: 1331 microversion: 2.1 time: 0.096862 Jun 22 17:15:45.599981 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 543/1058] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:45 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:46.617105 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:46.617838 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:46.623993 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:46.624484 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:46.625246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:46.625688 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:46.638959 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 HTTP/1.1 Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:15:46.640594 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:15:46.642266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13'} Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:15:46.643221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:15:46.644897 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:15:46.647091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:15:46.647091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-72beb524-dc74-4e4b-88ac-f54fa426e47b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 404 len: 111 microversion: 2.1 time: 0.029607 Jun 22 17:15:46.647091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 516/1059] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:46 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:15:46.651108 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c5aeb8f4-3cae-4616-8b0f-09c7e6f6b9a8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '.version_select at 0x7fe0a05b9ca0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:46.728504 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c5aeb8f4-3cae-4616-8b0f-09c7e6f6b9a8 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-962198864" status: 202 len: 0 microversion: 2.1 time: 0.081074 Jun 22 17:15:46.729058 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 544/1060] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 22 17:15:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-962198864 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:15:47.495234 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2cc84000-928f-4623-b108-6820ab2688a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: .version_select at 0x7fe0a030b430>, body: {"keypair": {"name": "tempest-keypair-1067261556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPHvPZMHC7Wm6rh/8v+0AGzBUGDT9Emf9oqp0VhY6hjGnxd193T5pjxDsnO0Hk9MEhF7bpG2WPtYeJb0BauWToVUUC0JDKogyCIlxZDXNqvAG/KGXtEVNLbLe5VW8IiBg=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:15:47.508984 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-2cc84000-928f-4623-b108-6820ab2688a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for project 069840ebd26e434c861568668776df52. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:15:47.512790 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-2cc84000-928f-4623-b108-6820ab2688a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for user 05951aa9ba2344a994f9fa1aa6fdb3bf and project 069840ebd26e434c861568668776df52. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:15:47.600372 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2cc84000-928f-4623-b108-6820ab2688a5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108838 Jun 22 17:15:47.600963 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 517/1061] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:15:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:15:49.776364 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1649401246", "imageRef": "e2184661-f477-4595-b964-a7d34e0d7464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62ce7501-df82-41e9-98c8-d1402b2e1e32"}], "security_groups": [{"name": "tempest-securitygroup--1538889757"}], "key_name": "tempest-keypair-1067261556", "user_data": "}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:15:49.876690 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] validate_networks() for [('62ce7501-df82-41e9-98c8-d1402b2e1e32', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:15:50.331947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:15:50.332409 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:15:50.332912 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:15:50.333317 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:15:50.333724 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:15:50.342366 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:50.342843 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:50.343633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:50.344063 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:50.360492 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for project 069840ebd26e434c861568668776df52. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:15:50.364886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Getting quotas for user 05951aa9ba2344a994f9fa1aa6fdb3bf and project 069840ebd26e434c861568668776df52. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:15:50.375555 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:15:50.377866 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2184661-f477-4595-b964-a7d34e0d7464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:15:50.509048 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-273de829-b67d-48ef-bc10-c315a394db6a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.737549 Jun 22 17:15:50.509695 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 545/1062] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:15:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:15:50.520227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-514ad446-7e63-43d7-bf76-9d960698a51b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:50.520853 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-514ad446-7e63-43d7-bf76-9d960698a51b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:50.573628 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-514ad446-7e63-43d7-bf76-9d960698a51b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:50.580989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-514ad446-7e63-43d7-bf76-9d960698a51b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1242 microversion: 2.1 time: 0.065187 Jun 22 17:15:50.581530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 518/1063] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:50 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:51.597797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-13e7d4e0-e72b-407e-8b50-c0c52a0ff08a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:51.598405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-13e7d4e0-e72b-407e-8b50-c0c52a0ff08a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:51.605326 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-13e7d4e0-e72b-407e-8b50-c0c52a0ff08a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:51.605778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-13e7d4e0-e72b-407e-8b50-c0c52a0ff08a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:51.606594 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-13e7d4e0-e72b-407e-8b50-c0c52a0ff08a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:51.607028 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-13e7d4e0-e72b-407e-8b50-c0c52a0ff08a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:51.667027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-13e7d4e0-e72b-407e-8b50-c0c52a0ff08a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:51.674798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-13e7d4e0-e72b-407e-8b50-c0c52a0ff08a tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1246 microversion: 2.1 time: 0.081405 Jun 22 17:15:51.675367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 546/1064] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:51 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:52.692862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-196107a8-38a6-416b-a573-7ed4de8f5972 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:52.693531 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-196107a8-38a6-416b-a573-7ed4de8f5972 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:52.700017 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-196107a8-38a6-416b-a573-7ed4de8f5972 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:52.700520 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-196107a8-38a6-416b-a573-7ed4de8f5972 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:52.701303 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-196107a8-38a6-416b-a573-7ed4de8f5972 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:52.701737 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-196107a8-38a6-416b-a573-7ed4de8f5972 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:52.784193 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-196107a8-38a6-416b-a573-7ed4de8f5972 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:52.792048 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-196107a8-38a6-416b-a573-7ed4de8f5972 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1302 microversion: 2.1 time: 0.103734 Jun 22 17:15:52.792863 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 519/1065] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:52 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:53.809693 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ddd7a33b-8683-42be-831a-792a72313521 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:53.810220 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ddd7a33b-8683-42be-831a-792a72313521 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:53.816791 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ddd7a33b-8683-42be-831a-792a72313521 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:53.817284 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ddd7a33b-8683-42be-831a-792a72313521 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:53.818037 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ddd7a33b-8683-42be-831a-792a72313521 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:53.818466 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ddd7a33b-8683-42be-831a-792a72313521 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:53.946198 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ddd7a33b-8683-42be-831a-792a72313521 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:53.955454 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ddd7a33b-8683-42be-831a-792a72313521 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.149358 Jun 22 17:15:53.966181 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 547/1066] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:53 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:54.282511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-8b9ecce3-bffd-4040-9515-35e600fedfee req-97081faa-60a6-40ef-a240-f73a6fad0cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9330ca43-a83b-4245-9fda-575b4adf6d93", "tag": "9a832077-4aa0-42fe-a625-275170d4858c"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:15:54.299079 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-8b9ecce3-bffd-4040-9515-35e600fedfee req-97081faa-60a6-40ef-a240-f73a6fad0cbd service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:54.299079 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-8b9ecce3-bffd-4040-9515-35e600fedfee req-97081faa-60a6-40ef-a240-f73a6fad0cbd service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:54.318640 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-8b9ecce3-bffd-4040-9515-35e600fedfee req-97081faa-60a6-40ef-a240-f73a6fad0cbd service nova] Creating event network-changed:9a832077-4aa0-42fe-a625-275170d4858c for instance 9330ca43-a83b-4245-9fda-575b4adf6d93 on hv-cinder-81045 Jun 22 17:15:54.325730 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-8b9ecce3-bffd-4040-9515-35e600fedfee req-97081faa-60a6-40ef-a240-f73a6fad0cbd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051202 Jun 22 17:15:54.327413 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 520/1067] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:15:54.972686 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-e973bde9-ffd3-4781-bc29-fd2b5cc78706 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:54.973371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-e973bde9-ffd3-4781-bc29-fd2b5cc78706 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:54.979863 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e973bde9-ffd3-4781-bc29-fd2b5cc78706 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:54.980330 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e973bde9-ffd3-4781-bc29-fd2b5cc78706 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:54.981090 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e973bde9-ffd3-4781-bc29-fd2b5cc78706 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:54.981518 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-e973bde9-ffd3-4781-bc29-fd2b5cc78706 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:55.113051 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-e973bde9-ffd3-4781-bc29-fd2b5cc78706 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:55.120416 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-e973bde9-ffd3-4781-bc29-fd2b5cc78706 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.151576 Jun 22 17:15:55.120978 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 548/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:54 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:56.138534 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-26b10991-1e7f-4d96-a389-c038fde5718b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:56.139227 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-26b10991-1e7f-4d96-a389-c038fde5718b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:56.146107 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26b10991-1e7f-4d96-a389-c038fde5718b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:56.146549 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26b10991-1e7f-4d96-a389-c038fde5718b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:56.147306 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26b10991-1e7f-4d96-a389-c038fde5718b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:56.147738 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-26b10991-1e7f-4d96-a389-c038fde5718b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:56.278328 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-26b10991-1e7f-4d96-a389-c038fde5718b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:56.286314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-26b10991-1e7f-4d96-a389-c038fde5718b tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.151865 Jun 22 17:15:56.287149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 521/1069] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:56 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:57.302822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-57bd7ed6-8e40-4136-a56c-d702c0c6f202 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:57.303471 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-57bd7ed6-8e40-4136-a56c-d702c0c6f202 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:57.310024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-57bd7ed6-8e40-4136-a56c-d702c0c6f202 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:57.310451 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-57bd7ed6-8e40-4136-a56c-d702c0c6f202 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:57.311210 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-57bd7ed6-8e40-4136-a56c-d702c0c6f202 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:57.311643 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-57bd7ed6-8e40-4136-a56c-d702c0c6f202 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:57.439665 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-57bd7ed6-8e40-4136-a56c-d702c0c6f202 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:57.447518 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-57bd7ed6-8e40-4136-a56c-d702c0c6f202 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.148690 Jun 22 17:15:57.448067 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 549/1070] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:57 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:58.464685 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e6482a8b-1918-49b4-9340-cca1e649d716 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:58.465347 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e6482a8b-1918-49b4-9340-cca1e649d716 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:58.471778 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e6482a8b-1918-49b4-9340-cca1e649d716 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:58.472348 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e6482a8b-1918-49b4-9340-cca1e649d716 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:58.473754 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e6482a8b-1918-49b4-9340-cca1e649d716 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:58.474218 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e6482a8b-1918-49b4-9340-cca1e649d716 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:58.607182 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e6482a8b-1918-49b4-9340-cca1e649d716 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:58.614713 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e6482a8b-1918-49b4-9340-cca1e649d716 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.154079 Jun 22 17:15:58.615262 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 522/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:58 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:15:59.631233 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7306b6a8-f5a8-46b7-a7d4-34e75ad1c552 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:15:59.631848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7306b6a8-f5a8-46b7-a7d4-34e75ad1c552 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:15:59.637927 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7306b6a8-f5a8-46b7-a7d4-34e75ad1c552 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:59.638367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7306b6a8-f5a8-46b7-a7d4-34e75ad1c552 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:59.639122 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7306b6a8-f5a8-46b7-a7d4-34e75ad1c552 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:15:59.639557 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7306b6a8-f5a8-46b7-a7d4-34e75ad1c552 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:15:59.769426 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7306b6a8-f5a8-46b7-a7d4-34e75ad1c552 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:15:59.776900 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7306b6a8-f5a8-46b7-a7d4-34e75ad1c552 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.150083 Jun 22 17:15:59.777460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 550/1072] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:15:59 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:00.794386 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d4c689f7-8e73-4d05-a917-3be63d4fd26c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:00.795158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d4c689f7-8e73-4d05-a917-3be63d4fd26c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:00.797589 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:00.798245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:00.802907 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d4c689f7-8e73-4d05-a917-3be63d4fd26c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:00.803348 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d4c689f7-8e73-4d05-a917-3be63d4fd26c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:00.804127 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d4c689f7-8e73-4d05-a917-3be63d4fd26c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:00.804563 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d4c689f7-8e73-4d05-a917-3be63d4fd26c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:00.808555 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:00.863887 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-a59df6fe-4b02-4537-8b5a-6b7b0fca9969 req-b8cc6f12-3544-4737-b164-84ccde71ab2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9330ca43-a83b-4245-9fda-575b4adf6d93", "name": "network-vif-plugged", "status": "completed", "tag": "9a832077-4aa0-42fe-a625-275170d4858c"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:16:00.870733 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:00.871404 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:00.874248 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-a59df6fe-4b02-4537-8b5a-6b7b0fca9969 req-b8cc6f12-3544-4737-b164-84ccde71ab2f service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:00.874695 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-a59df6fe-4b02-4537-8b5a-6b7b0fca9969 req-b8cc6f12-3544-4737-b164-84ccde71ab2f service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:00.886603 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-a59df6fe-4b02-4537-8b5a-6b7b0fca9969 req-b8cc6f12-3544-4737-b164-84ccde71ab2f service nova] Creating event network-vif-plugged:9a832077-4aa0-42fe-a625-275170d4858c for instance 9330ca43-a83b-4245-9fda-575b4adf6d93 on hv-cinder-81045 Jun 22 17:16:00.891553 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-a59df6fe-4b02-4537-8b5a-6b7b0fca9969 req-b8cc6f12-3544-4737-b164-84ccde71ab2f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031424 Jun 22 17:16:00.893679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 551/1073] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:16:00.941018 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d4c689f7-8e73-4d05-a917-3be63d4fd26c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:00.949906 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d4c689f7-8e73-4d05-a917-3be63d4fd26c tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.159627 Jun 22 17:16:00.950465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 523/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:00 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:01.967795 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-7c8f47cf-120c-4c3b-875f-a3ffc51ddad2 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:01.968528 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-7c8f47cf-120c-4c3b-875f-a3ffc51ddad2 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:01.976419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c8f47cf-120c-4c3b-875f-a3ffc51ddad2 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:01.976875 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c8f47cf-120c-4c3b-875f-a3ffc51ddad2 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:01.977640 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c8f47cf-120c-4c3b-875f-a3ffc51ddad2 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:01.978079 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-7c8f47cf-120c-4c3b-875f-a3ffc51ddad2 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:02.106611 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-7c8f47cf-120c-4c3b-875f-a3ffc51ddad2 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:02.113985 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-7c8f47cf-120c-4c3b-875f-a3ffc51ddad2 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.150869 Jun 22 17:16:02.114585 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 552/1075] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:01 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:03.131920 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-390a8644-a1af-43b0-b639-2c0bc8b16969 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:03.132688 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-390a8644-a1af-43b0-b639-2c0bc8b16969 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:03.142888 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-390a8644-a1af-43b0-b639-2c0bc8b16969 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:03.143345 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-390a8644-a1af-43b0-b639-2c0bc8b16969 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:03.144141 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-390a8644-a1af-43b0-b639-2c0bc8b16969 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:03.144616 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-390a8644-a1af-43b0-b639-2c0bc8b16969 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:03.320941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-390a8644-a1af-43b0-b639-2c0bc8b16969 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:03.328395 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-390a8644-a1af-43b0-b639-2c0bc8b16969 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1368 microversion: 2.1 time: 0.201241 Jun 22 17:16:03.328962 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 524/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:03 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:04.344938 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d84cf71e-259f-493d-8800-7b1e13087d78 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:04.345551 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d84cf71e-259f-493d-8800-7b1e13087d78 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:04.351972 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d84cf71e-259f-493d-8800-7b1e13087d78 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:04.352457 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d84cf71e-259f-493d-8800-7b1e13087d78 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:04.353235 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d84cf71e-259f-493d-8800-7b1e13087d78 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:04.353668 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-d84cf71e-259f-493d-8800-7b1e13087d78 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:04.484006 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d84cf71e-259f-493d-8800-7b1e13087d78 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:04.491424 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d84cf71e-259f-493d-8800-7b1e13087d78 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1558 microversion: 2.1 time: 0.150567 Jun 22 17:16:04.492582 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 553/1077] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:04 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:04.508800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-61e93469-b638-4a49-9acf-e91bd18c2043 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:04.509312 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-61e93469-b638-4a49-9acf-e91bd18c2043 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:04.516334 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61e93469-b638-4a49-9acf-e91bd18c2043 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:04.516790 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61e93469-b638-4a49-9acf-e91bd18c2043 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:04.517561 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61e93469-b638-4a49-9acf-e91bd18c2043 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:04.517995 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61e93469-b638-4a49-9acf-e91bd18c2043 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:04.599393 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-61e93469-b638-4a49-9acf-e91bd18c2043 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094772 Jun 22 17:16:04.599985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 525/1078] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 17:16:04 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:16:06.037667 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-8484008f-5c8d-4e98-96b1-e610760c705a req-133340be-38f1-455e-a03e-0c3eab8779c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9330ca43-a83b-4245-9fda-575b4adf6d93", "tag": "9a832077-4aa0-42fe-a625-275170d4858c"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:16:06.047086 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-8484008f-5c8d-4e98-96b1-e610760c705a req-133340be-38f1-455e-a03e-0c3eab8779c9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:06.047629 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-8484008f-5c8d-4e98-96b1-e610760c705a req-133340be-38f1-455e-a03e-0c3eab8779c9 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:06.061156 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-8484008f-5c8d-4e98-96b1-e610760c705a req-133340be-38f1-455e-a03e-0c3eab8779c9 service nova] Creating event network-changed:9a832077-4aa0-42fe-a625-275170d4858c for instance 9330ca43-a83b-4245-9fda-575b4adf6d93 on hv-cinder-81045 Jun 22 17:16:06.066874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-8484008f-5c8d-4e98-96b1-e610760c705a req-133340be-38f1-455e-a03e-0c3eab8779c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157695 Jun 22 17:16:06.068530 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 554/1079] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:16:16.346213 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=5 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:16.537511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4db229ef-f5c5-42cf-aa25-08b7c32b97ef tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Action: 'create', calling method: .version_select at 0x7fe0a0415310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-119335214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjUuBYszL5kI6YRU9Ih60L1dpojTqXoWHtMRSeL0CElqVQId7Qu7YvEo7zy/npDAyHRqYfANN52mq8LXbrxP1XZ61AGAZYZbCfTOX+T4hHh2GlwERlfomPPYMxw4MwhNA=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:16:16.552611 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-4db229ef-f5c5-42cf-aa25-08b7c32b97ef tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Getting quotas for project 2c32a4df73e946b2844051778a16a8c0. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:16:16.557022 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-4db229ef-f5c5-42cf-aa25-08b7c32b97ef tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Getting quotas for user 00da4e0bbeba4a1f954ea2d27ff18f59 and project 2c32a4df73e946b2844051778a16a8c0. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:16:16.637792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4db229ef-f5c5-42cf-aa25-08b7c32b97ef tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.292794 Jun 22 17:16:16.639039 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 526/1080] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 17:16:16 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:16:41.076653 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:41.077529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=86 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:41.081746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1032536748", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-119335214", "security_groups": [{"name": "tempest-secgroup-smoke-470992051"}], "block_device_mapping_v2": [{"uuid": "79638335-18dd-4f41-b0d1-a767c5f0bcf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abd066b9-f80d-4516-83dc-19b016a13318"}]}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:16:41.197539 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.network.neutron [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] validate_networks() for [('abd066b9-f80d-4516-83dc-19b016a13318', None, None, None, None, None)] {{(pid=118471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:16:41.562629 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Flavor limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:16:41.563064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Image limits 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:16:41.563535 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Flavor pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:16:41.563948 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Image pref 0:0:0 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:16:41.564394 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.virt.hardware [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:16:41.573156 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:41.573606 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:41.574411 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:41.574853 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:41.592508 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Getting quotas for project 2c32a4df73e946b2844051778a16a8c0. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:16:41.596848 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.quota [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Getting quotas for user 00da4e0bbeba4a1f954ea2d27ff18f59 and project 2c32a4df73e946b2844051778a16a8c0. Resources: {'instances', 'cores', 'ram'} {{(pid=118471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:16:41.652183 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Going to run 1 instances... {{(pid=118471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:16:41.655011 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='79638335-18dd-4f41-b0d1-a767c5f0bcf0',volume_size=None,volume_type=None)] {{(pid=118471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:16:42.019379 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c0a16155-279f-49f6-9e73-cdbd0cd07b1f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.944240 Jun 22 17:16:42.023975 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 555/1081] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:16:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:16:42.027463 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=15 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:42.028261 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:42.029647 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:42.033625 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7b6a91a-0930-4e2d-9d28-b33346267fb8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:42.034238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7b6a91a-0930-4e2d-9d28-b33346267fb8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:42.087792 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d7b6a91a-0930-4e2d-9d28-b33346267fb8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:42.096272 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7b6a91a-0930-4e2d-9d28-b33346267fb8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1094 microversion: 2.1 time: 0.069072 Jun 22 17:16:42.096272 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 527/1082] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:42 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:43.112648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2a1f4060-5429-4c76-96e1-d54e296113a3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:43.115398 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-2a1f4060-5429-4c76-96e1-d54e296113a3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:43.120254 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2a1f4060-5429-4c76-96e1-d54e296113a3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:43.120794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2a1f4060-5429-4c76-96e1-d54e296113a3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:43.121497 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2a1f4060-5429-4c76-96e1-d54e296113a3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:43.121938 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-2a1f4060-5429-4c76-96e1-d54e296113a3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:43.182518 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-2a1f4060-5429-4c76-96e1-d54e296113a3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:43.189935 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2a1f4060-5429-4c76-96e1-d54e296113a3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1144 microversion: 2.1 time: 0.081797 Jun 22 17:16:43.190489 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 556/1083] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:43 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:44.207503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-19214a93-5c7c-49fc-a357-623eda17c1a4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:44.208132 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-19214a93-5c7c-49fc-a357-623eda17c1a4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:44.215545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19214a93-5c7c-49fc-a357-623eda17c1a4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:44.215993 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19214a93-5c7c-49fc-a357-623eda17c1a4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:44.216788 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19214a93-5c7c-49fc-a357-623eda17c1a4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:44.217309 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19214a93-5c7c-49fc-a357-623eda17c1a4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:44.289276 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-19214a93-5c7c-49fc-a357-623eda17c1a4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:44.297481 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-19214a93-5c7c-49fc-a357-623eda17c1a4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1200 microversion: 2.1 time: 0.094278 Jun 22 17:16:44.298820 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 528/1084] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:44 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1200 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:45.315658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0f39a44a-afe3-466b-bf8f-e21d9709e460 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:45.316470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0f39a44a-afe3-466b-bf8f-e21d9709e460 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:45.322967 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0f39a44a-afe3-466b-bf8f-e21d9709e460 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:45.323417 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0f39a44a-afe3-466b-bf8f-e21d9709e460 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:45.324205 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0f39a44a-afe3-466b-bf8f-e21d9709e460 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:45.324642 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0f39a44a-afe3-466b-bf8f-e21d9709e460 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:45.462809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0f39a44a-afe3-466b-bf8f-e21d9709e460 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:45.470336 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0f39a44a-afe3-466b-bf8f-e21d9709e460 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1277 microversion: 2.1 time: 0.159180 Jun 22 17:16:45.470894 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 557/1085] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:45 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:45.887438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-c779fb82-be55-48c9-ac22-0c61e310912a req-3aaceed6-8e5a-46a6-a2f6-7703a067f7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8000b1a5-9448-4b4b-bc6b-3006352c7796", "tag": "46857e9b-715a-48b6-8e5b-6106495e8ef3"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:16:45.902947 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-c779fb82-be55-48c9-ac22-0c61e310912a req-3aaceed6-8e5a-46a6-a2f6-7703a067f7f3 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:45.903387 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-c779fb82-be55-48c9-ac22-0c61e310912a req-3aaceed6-8e5a-46a6-a2f6-7703a067f7f3 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:45.915891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-c779fb82-be55-48c9-ac22-0c61e310912a req-3aaceed6-8e5a-46a6-a2f6-7703a067f7f3 service nova] Creating event network-changed:46857e9b-715a-48b6-8e5b-6106495e8ef3 for instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 on hv-cinder-81045 Jun 22 17:16:45.921364 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-c779fb82-be55-48c9-ac22-0c61e310912a req-3aaceed6-8e5a-46a6-a2f6-7703a067f7f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037695 Jun 22 17:16:45.921960 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 529/1086] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:16:46.486734 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ebf86b28-a7ef-4b0a-bf54-a870b57d093e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:46.487344 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ebf86b28-a7ef-4b0a-bf54-a870b57d093e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:46.493886 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ebf86b28-a7ef-4b0a-bf54-a870b57d093e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:46.494335 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ebf86b28-a7ef-4b0a-bf54-a870b57d093e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:46.495094 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ebf86b28-a7ef-4b0a-bf54-a870b57d093e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:46.495525 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ebf86b28-a7ef-4b0a-bf54-a870b57d093e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:46.627680 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ebf86b28-a7ef-4b0a-bf54-a870b57d093e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:46.635619 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ebf86b28-a7ef-4b0a-bf54-a870b57d093e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.152715 Jun 22 17:16:46.636201 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 558/1087] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:46 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:47.653941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72a5b8d8-35c3-4966-8df8-1d7f2ddd9c2f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:47.654626 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-72a5b8d8-35c3-4966-8df8-1d7f2ddd9c2f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:47.660704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72a5b8d8-35c3-4966-8df8-1d7f2ddd9c2f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:47.661150 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72a5b8d8-35c3-4966-8df8-1d7f2ddd9c2f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:47.661911 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72a5b8d8-35c3-4966-8df8-1d7f2ddd9c2f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:47.662933 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72a5b8d8-35c3-4966-8df8-1d7f2ddd9c2f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:47.790512 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-72a5b8d8-35c3-4966-8df8-1d7f2ddd9c2f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:47.798096 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-72a5b8d8-35c3-4966-8df8-1d7f2ddd9c2f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.148816 Jun 22 17:16:47.798642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 530/1088] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:47 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:48.814415 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ee11f69d-00f8-47c6-a7be-4feee3acb5a1 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:48.815001 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ee11f69d-00f8-47c6-a7be-4feee3acb5a1 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:48.821469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee11f69d-00f8-47c6-a7be-4feee3acb5a1 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:48.821947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee11f69d-00f8-47c6-a7be-4feee3acb5a1 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:48.822703 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee11f69d-00f8-47c6-a7be-4feee3acb5a1 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:48.823136 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ee11f69d-00f8-47c6-a7be-4feee3acb5a1 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:48.950612 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ee11f69d-00f8-47c6-a7be-4feee3acb5a1 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:48.957922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ee11f69d-00f8-47c6-a7be-4feee3acb5a1 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.147338 Jun 22 17:16:48.958486 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 559/1089] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:48 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:49.975732 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8a2884c7-9575-4ce0-8514-aded1b21efd2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:49.976369 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8a2884c7-9575-4ce0-8514-aded1b21efd2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:49.982760 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a2884c7-9575-4ce0-8514-aded1b21efd2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:49.983209 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a2884c7-9575-4ce0-8514-aded1b21efd2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:49.983966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a2884c7-9575-4ce0-8514-aded1b21efd2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:49.984427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a2884c7-9575-4ce0-8514-aded1b21efd2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:50.110646 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8a2884c7-9575-4ce0-8514-aded1b21efd2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:50.118720 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8a2884c7-9575-4ce0-8514-aded1b21efd2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.147411 Jun 22 17:16:50.119278 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 531/1090] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:49 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:51.135904 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-685423cb-d90d-499e-be3b-33c90aecbced tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:51.136544 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-685423cb-d90d-499e-be3b-33c90aecbced tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:51.142987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-685423cb-d90d-499e-be3b-33c90aecbced tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:51.143439 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-685423cb-d90d-499e-be3b-33c90aecbced tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:51.144264 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-685423cb-d90d-499e-be3b-33c90aecbced tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:51.144704 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-685423cb-d90d-499e-be3b-33c90aecbced tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:51.275177 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-685423cb-d90d-499e-be3b-33c90aecbced tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:51.282556 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-685423cb-d90d-499e-be3b-33c90aecbced tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.150540 Jun 22 17:16:51.283116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 560/1091] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:51 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:52.299988 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aba63d65-328e-41c0-9358-932eef7abf0c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:52.300556 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aba63d65-328e-41c0-9358-932eef7abf0c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:52.307545 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aba63d65-328e-41c0-9358-932eef7abf0c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:52.307983 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aba63d65-328e-41c0-9358-932eef7abf0c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:52.308766 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aba63d65-328e-41c0-9358-932eef7abf0c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:52.309191 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aba63d65-328e-41c0-9358-932eef7abf0c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:52.439891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-aba63d65-328e-41c0-9358-932eef7abf0c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:52.447876 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aba63d65-328e-41c0-9358-932eef7abf0c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.151796 Jun 22 17:16:52.448458 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 532/1092] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:52 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:53.464983 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5c43f058-3598-484f-b87a-1d8a31fda965 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:53.465654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5c43f058-3598-484f-b87a-1d8a31fda965 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:53.467929 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:53.468907 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=6 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:53.474386 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5c43f058-3598-484f-b87a-1d8a31fda965 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:53.477880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5c43f058-3598-484f-b87a-1d8a31fda965 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:53.477880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5c43f058-3598-484f-b87a-1d8a31fda965 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:53.477880 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5c43f058-3598-484f-b87a-1d8a31fda965 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:53.604259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5c43f058-3598-484f-b87a-1d8a31fda965 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:53.611578 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5c43f058-3598-484f-b87a-1d8a31fda965 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.150435 Jun 22 17:16:53.612146 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 561/1093] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:53 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:54.627681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-66a8f9bb-fbac-47a0-a007-0d223c82ff4a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:54.628316 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-66a8f9bb-fbac-47a0-a007-0d223c82ff4a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:54.630355 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:54.635101 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66a8f9bb-fbac-47a0-a007-0d223c82ff4a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:54.635541 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66a8f9bb-fbac-47a0-a007-0d223c82ff4a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:54.636319 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66a8f9bb-fbac-47a0-a007-0d223c82ff4a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:54.636748 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66a8f9bb-fbac-47a0-a007-0d223c82ff4a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:54.767978 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-66a8f9bb-fbac-47a0-a007-0d223c82ff4a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:54.775296 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-66a8f9bb-fbac-47a0-a007-0d223c82ff4a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.151480 Jun 22 17:16:54.775844 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 533/1094] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:54 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:55.791874 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-3a8e5ee3-de5d-477a-95c2-3f787d0a9722 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:55.792541 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-3a8e5ee3-de5d-477a-95c2-3f787d0a9722 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:55.799107 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a8e5ee3-de5d-477a-95c2-3f787d0a9722 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:55.799552 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a8e5ee3-de5d-477a-95c2-3f787d0a9722 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:55.800338 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a8e5ee3-de5d-477a-95c2-3f787d0a9722 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:55.800766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-3a8e5ee3-de5d-477a-95c2-3f787d0a9722 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:55.933909 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-3a8e5ee3-de5d-477a-95c2-3f787d0a9722 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:55.941388 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-3a8e5ee3-de5d-477a-95c2-3f787d0a9722 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.153514 Jun 22 17:16:55.941942 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 562/1095] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:55 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:56.958491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a5ffeee1-1e05-4194-accf-f4475f80d01f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:56.959030 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a5ffeee1-1e05-4194-accf-f4475f80d01f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:56.966061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5ffeee1-1e05-4194-accf-f4475f80d01f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:56.966505 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5ffeee1-1e05-4194-accf-f4475f80d01f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:56.967255 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5ffeee1-1e05-4194-accf-f4475f80d01f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:56.967713 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a5ffeee1-1e05-4194-accf-f4475f80d01f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:57.107705 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a5ffeee1-1e05-4194-accf-f4475f80d01f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:57.116069 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a5ffeee1-1e05-4194-accf-f4475f80d01f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.161460 Jun 22 17:16:57.120179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 534/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:56 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:57.245959 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-a6751dfc-fa2f-4c0b-8f54-719783074eaf req-f4b36797-8843-46d3-9178-1651e4b8074e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8000b1a5-9448-4b4b-bc6b-3006352c7796", "name": "network-vif-plugged", "status": "completed", "tag": "46857e9b-715a-48b6-8e5b-6106495e8ef3"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:16:57.254447 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-a6751dfc-fa2f-4c0b-8f54-719783074eaf req-f4b36797-8843-46d3-9178-1651e4b8074e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:57.254883 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-a6751dfc-fa2f-4c0b-8f54-719783074eaf req-f4b36797-8843-46d3-9178-1651e4b8074e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:57.266206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-a6751dfc-fa2f-4c0b-8f54-719783074eaf req-f4b36797-8843-46d3-9178-1651e4b8074e service nova] Creating event network-vif-plugged:46857e9b-715a-48b6-8e5b-6106495e8ef3 for instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 on hv-cinder-81045 Jun 22 17:16:57.271331 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-a6751dfc-fa2f-4c0b-8f54-719783074eaf req-f4b36797-8843-46d3-9178-1651e4b8074e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029574 Jun 22 17:16:57.271954 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 563/1097] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:16:58.132733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-66228560-cfae-4c24-8ac7-c9b4f6849e1c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:58.133345 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-66228560-cfae-4c24-8ac7-c9b4f6849e1c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:58.139789 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66228560-cfae-4c24-8ac7-c9b4f6849e1c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:58.140278 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66228560-cfae-4c24-8ac7-c9b4f6849e1c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:58.141041 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66228560-cfae-4c24-8ac7-c9b4f6849e1c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:58.141475 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66228560-cfae-4c24-8ac7-c9b4f6849e1c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:58.271617 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-66228560-cfae-4c24-8ac7-c9b4f6849e1c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:58.279603 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-66228560-cfae-4c24-8ac7-c9b4f6849e1c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1265 microversion: 2.1 time: 0.150664 Jun 22 17:16:58.280094 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 535/1098] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:58 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:59.297445 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-aa4ee15b-bbd2-4bd2-871c-de63940893bb tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:59.298058 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-aa4ee15b-bbd2-4bd2-871c-de63940893bb tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:59.304255 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aa4ee15b-bbd2-4bd2-871c-de63940893bb tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:59.304702 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aa4ee15b-bbd2-4bd2-871c-de63940893bb tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:59.305450 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aa4ee15b-bbd2-4bd2-871c-de63940893bb tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:59.305903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-aa4ee15b-bbd2-4bd2-871c-de63940893bb tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:59.437762 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-aa4ee15b-bbd2-4bd2-871c-de63940893bb tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:59.445359 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-aa4ee15b-bbd2-4bd2-871c-de63940893bb tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1450 microversion: 2.1 time: 0.152904 Jun 22 17:16:59.445909 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 564/1099] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:59 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:16:59.463330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-17ef9932-c7ca-4581-9996-e0dd10187e7c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:16:59.463941 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-17ef9932-c7ca-4581-9996-e0dd10187e7c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:16:59.470155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-17ef9932-c7ca-4581-9996-e0dd10187e7c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:59.470611 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-17ef9932-c7ca-4581-9996-e0dd10187e7c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:59.471362 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-17ef9932-c7ca-4581-9996-e0dd10187e7c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:16:59.471796 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-17ef9932-c7ca-4581-9996-e0dd10187e7c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:16:59.598095 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-17ef9932-c7ca-4581-9996-e0dd10187e7c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:16:59.606373 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-17ef9932-c7ca-4581-9996-e0dd10187e7c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1450 microversion: 2.1 time: 0.147545 Jun 22 17:16:59.606929 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 536/1100] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:16:59 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:17:01.765533 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-1cae4eb0-b387-4593-b593-de2471ae91fd req-40cf5434-c99a-4839-b342-24c855ad63fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8000b1a5-9448-4b4b-bc6b-3006352c7796", "tag": "46857e9b-715a-48b6-8e5b-6106495e8ef3"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:17:01.773830 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-1cae4eb0-b387-4593-b593-de2471ae91fd req-40cf5434-c99a-4839-b342-24c855ad63fb service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:01.774272 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-1cae4eb0-b387-4593-b593-de2471ae91fd req-40cf5434-c99a-4839-b342-24c855ad63fb service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:01.785113 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-1cae4eb0-b387-4593-b593-de2471ae91fd req-40cf5434-c99a-4839-b342-24c855ad63fb service nova] Creating event network-changed:46857e9b-715a-48b6-8e5b-6106495e8ef3 for instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 on hv-cinder-81045 Jun 22 17:17:01.789902 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-1cae4eb0-b387-4593-b593-de2471ae91fd req-40cf5434-c99a-4839-b342-24c855ad63fb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028023 Jun 22 17:17:01.790728 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 565/1101] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:17:21.813623 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a16df2dd-ccc0-4ea2-a487-f37ace0c3292 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:21.814192 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a16df2dd-ccc0-4ea2-a487-f37ace0c3292 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:21.816488 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=22 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:21.817142 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=50 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:21.821808 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a16df2dd-ccc0-4ea2-a487-f37ace0c3292 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:21.825451 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a16df2dd-ccc0-4ea2-a487-f37ace0c3292 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:21.825451 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a16df2dd-ccc0-4ea2-a487-f37ace0c3292 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:21.825451 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a16df2dd-ccc0-4ea2-a487-f37ace0c3292 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:21.847786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a16df2dd-ccc0-4ea2-a487-f37ace0c3292 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/ips" status: 200 len: 150 microversion: 2.1 time: 0.038086 Jun 22 17:17:21.854343 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 537/1102] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 17:17:21 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:17:23.419473 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:23.420506 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=54 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:23.424916 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-19086dd3-6d65-4f5e-8bbb-f26dba1bff1d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bebbf58-3584-4c06-a3ff-737031c3de47"}} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:17:23.426054 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-19086dd3-6d65-4f5e-8bbb-f26dba1bff1d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:23.432258 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19086dd3-6d65-4f5e-8bbb-f26dba1bff1d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:23.433266 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19086dd3-6d65-4f5e-8bbb-f26dba1bff1d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:23.434026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19086dd3-6d65-4f5e-8bbb-f26dba1bff1d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:23.434460 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-19086dd3-6d65-4f5e-8bbb-f26dba1bff1d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:24.313301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-19086dd3-6d65-4f5e-8bbb-f26dba1bff1d tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "POST /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895154 Jun 22 17:17:24.313847 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 566/1103] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 17:17:23 2022] POST /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:17:31.888265 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-13857819-5d43-47bd-a8e5-b9b708e26dc5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:31.888756 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-13857819-5d43-47bd-a8e5-b9b708e26dc5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:31.895228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-13857819-5d43-47bd-a8e5-b9b708e26dc5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:31.895681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-13857819-5d43-47bd-a8e5-b9b708e26dc5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:31.896473 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-13857819-5d43-47bd-a8e5-b9b708e26dc5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:31.896915 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-13857819-5d43-47bd-a8e5-b9b708e26dc5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:31.974663 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-13857819-5d43-47bd-a8e5-b9b708e26dc5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lazy-loading 'services' on Instance uuid 9330ca43-a83b-4245-9fda-575b4adf6d93 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:17:32.176592 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-13857819-5d43-47bd-a8e5-b9b708e26dc5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments/7bebbf58-3584-4c06-a3ff-737031c3de47" status: 202 len: 0 microversion: 2.1 time: 0.293017 Jun 22 17:17:32.177165 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 538/1104] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 17:17:31 2022] DELETE /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments/7bebbf58-3584-4c06-a3ff-737031c3de47 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 17:17:32.186617 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-4d6581fd-526d-4ba5-aec2-f35f637d9d69 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:32.187640 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-4d6581fd-526d-4ba5-aec2-f35f637d9d69 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:32.194488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4d6581fd-526d-4ba5-aec2-f35f637d9d69 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:32.194938 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4d6581fd-526d-4ba5-aec2-f35f637d9d69 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:32.197644 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4d6581fd-526d-4ba5-aec2-f35f637d9d69 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:32.197644 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-4d6581fd-526d-4ba5-aec2-f35f637d9d69 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:32.225628 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-4d6581fd-526d-4ba5-aec2-f35f637d9d69 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043899 Jun 22 17:17:32.226174 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 567/1105] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:17:32 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:17:33.238364 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0c58cd9d-debf-48c6-b3af-578d8c7a53c0 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:33.239370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0c58cd9d-debf-48c6-b3af-578d8c7a53c0 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:33.245779 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c58cd9d-debf-48c6-b3af-578d8c7a53c0 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:33.246301 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c58cd9d-debf-48c6-b3af-578d8c7a53c0 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:33.247253 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c58cd9d-debf-48c6-b3af-578d8c7a53c0 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:33.247689 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c58cd9d-debf-48c6-b3af-578d8c7a53c0 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:33.276909 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0c58cd9d-debf-48c6-b3af-578d8c7a53c0 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Jun 22 17:17:33.278069 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 539/1106] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:17:33 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:17:34.289162 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f18a28e0-c520-46ee-acc2-f4a871121e26 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:34.290008 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f18a28e0-c520-46ee-acc2-f4a871121e26 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:34.296759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f18a28e0-c520-46ee-acc2-f4a871121e26 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:34.297222 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f18a28e0-c520-46ee-acc2-f4a871121e26 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:34.297971 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f18a28e0-c520-46ee-acc2-f4a871121e26 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:34.298402 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f18a28e0-c520-46ee-acc2-f4a871121e26 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:34.326538 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f18a28e0-c520-46ee-acc2-f4a871121e26 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041432 Jun 22 17:17:34.327075 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 568/1107] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 17:17:34 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 17:17:34.382189 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-61b55d60-3ea1-4601-a875-bef6fa7808aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:34.382692 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-61b55d60-3ea1-4601-a875-bef6fa7808aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:34.389543 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61b55d60-3ea1-4601-a875-bef6fa7808aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:34.389992 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61b55d60-3ea1-4601-a875-bef6fa7808aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:34.390747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61b55d60-3ea1-4601-a875-bef6fa7808aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:34.391182 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-61b55d60-3ea1-4601-a875-bef6fa7808aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:34.414943 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-61b55d60-3ea1-4601-a875-bef6fa7808aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:17:34.679547 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-61b55d60-3ea1-4601-a875-bef6fa7808aa tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 204 len: 0 microversion: 2.1 time: 0.300792 Jun 22 17:17:34.680159 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 540/1108] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:17:34 2022] DELETE /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:17:34.688861 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-323202c5-c359-4d8c-99c1-56eb86144453 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:34.689447 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-323202c5-c359-4d8c-99c1-56eb86144453 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:34.695683 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-323202c5-c359-4d8c-99c1-56eb86144453 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:34.696171 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-323202c5-c359-4d8c-99c1-56eb86144453 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:34.696936 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-323202c5-c359-4d8c-99c1-56eb86144453 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:34.697367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-323202c5-c359-4d8c-99c1-56eb86144453 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:34.827537 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-323202c5-c359-4d8c-99c1-56eb86144453 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:17:34.835217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-323202c5-c359-4d8c-99c1-56eb86144453 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1683 microversion: 2.1 time: 0.150298 Jun 22 17:17:34.835777 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 569/1109] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:34 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:17:35.852991 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6b9df44a-8b69-4144-90b8-3bfcad77ae7f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:35.853750 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6b9df44a-8b69-4144-90b8-3bfcad77ae7f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:35.860669 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b9df44a-8b69-4144-90b8-3bfcad77ae7f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:35.861123 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b9df44a-8b69-4144-90b8-3bfcad77ae7f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:35.861880 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b9df44a-8b69-4144-90b8-3bfcad77ae7f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:35.862314 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b9df44a-8b69-4144-90b8-3bfcad77ae7f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:35.989952 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6b9df44a-8b69-4144-90b8-3bfcad77ae7f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:17:35.997432 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6b9df44a-8b69-4144-90b8-3bfcad77ae7f tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1683 microversion: 2.1 time: 0.148710 Jun 22 17:17:35.998022 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 541/1110] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:35 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:17:37.015042 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a3ea548d-c821-4320-a1b8-b96c94a5e1f6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:37.015579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a3ea548d-c821-4320-a1b8-b96c94a5e1f6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:37.022844 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a3ea548d-c821-4320-a1b8-b96c94a5e1f6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:37.027184 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a3ea548d-c821-4320-a1b8-b96c94a5e1f6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:37.027184 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a3ea548d-c821-4320-a1b8-b96c94a5e1f6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:37.027184 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a3ea548d-c821-4320-a1b8-b96c94a5e1f6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:37.093424 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a3ea548d-c821-4320-a1b8-b96c94a5e1f6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:17:37.101303 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a3ea548d-c821-4320-a1b8-b96c94a5e1f6 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1615 microversion: 2.1 time: 0.090366 Jun 22 17:17:37.101993 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 570/1111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:37 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:17:37.345786 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-c9c595e7-ac8c-4a2a-bf6c-6c40f3ff26a2 req-28488a5e-a967-45f4-b4d3-ab3354aa6b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9330ca43-a83b-4245-9fda-575b4adf6d93", "name": "network-vif-deleted", "tag": "9a832077-4aa0-42fe-a625-275170d4858c"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:17:37.359292 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-c9c595e7-ac8c-4a2a-bf6c-6c40f3ff26a2 req-28488a5e-a967-45f4-b4d3-ab3354aa6b85 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:37.359292 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-c9c595e7-ac8c-4a2a-bf6c-6c40f3ff26a2 req-28488a5e-a967-45f4-b4d3-ab3354aa6b85 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:37.372429 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-c9c595e7-ac8c-4a2a-bf6c-6c40f3ff26a2 req-28488a5e-a967-45f4-b4d3-ab3354aa6b85 service nova] Creating event network-vif-deleted:9a832077-4aa0-42fe-a625-275170d4858c for instance 9330ca43-a83b-4245-9fda-575b4adf6d93 on hv-cinder-81045 Jun 22 17:17:37.377372 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-c9c595e7-ac8c-4a2a-bf6c-6c40f3ff26a2 req-28488a5e-a967-45f4-b4d3-ab3354aa6b85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035380 Jun 22 17:17:37.377976 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 542/1112] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:17:38.118784 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:38.119545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:38.126564 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:38.127101 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:38.127947 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:38.128417 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:38.160892 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:38.161341 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:38.161797 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.objects.instance [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lazy-loading 'fault' on Instance uuid 9330ca43-a83b-4245-9fda-575b4adf6d93 {{(pid=118471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:17:38.208622 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05951aa9ba2344a994f9fa1aa6fdb3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069840ebd26e434c861568668776df52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:17:38.217064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-dfd7dea3-b0f7-4bb4-ac6d-b6b00e247273 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 200 len: 1332 microversion: 2.1 time: 0.102169 Jun 22 17:17:38.217633 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 571/1113] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:38 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:17:39.235672 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:39.236400 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:39.242530 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:39.242985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:39.243747 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:39.244221 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:39.259059 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 HTTP/1.1 Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:17:39.260772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:39.262513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '9330ca43-a83b-4245-9fda-575b4adf6d93'} Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:39.263382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:39.264787 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:39.266449 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:39.266449 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e5bd9e24-dcdf-4ecb-8cd9-c518aa50c5b5 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 404 len: 111 microversion: 2.1 time: 0.031692 Jun 22 17:17:39.266449 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 543/1114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:39 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:17:39.271669 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-2ee63e2a-9f89-4520-a877-f27b0be1ffca tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '.version_select at 0x7fe0a0f169d0>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:39.363684 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-2ee63e2a-9f89-4520-a877-f27b0be1ffca tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067261556" status: 202 len: 0 microversion: 2.1 time: 0.095731 Jun 22 17:17:39.364316 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 572/1115] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 22 17:17:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067261556 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 17:17:41.402930 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:41.403595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:41.410878 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:41.411332 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:41.412128 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:41.412570 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:41.426360 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 HTTP/1.1 Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:17:41.427935 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.429609 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '9330ca43-a83b-4245-9fda-575b4adf6d93'} Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:41.430527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.432093 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.433825 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:41.433825 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e1ffacd2-fd91-47c4-978c-99e924da3f10 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 404 len: 111 microversion: 2.1 time: 0.030630 Jun 22 17:17:41.433825 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 544/1116] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:17:41 2022] DELETE /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:17:41.438400 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:41.439022 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 9330ca43-a83b-4245-9fda-575b4adf6d93] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:41.445805 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:41.446256 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:41.447018 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:41.447457 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:41.462264 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 HTTP/1.1 Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:17:41.463889 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.466149 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '9330ca43-a83b-4245-9fda-575b4adf6d93'} Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:41.467039 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. Jun 22 17:17:41.468676 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:41.470116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 9330ca43-a83b-4245-9fda-575b4adf6d93 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:41.470116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-8c216a07-dcb1-46be-91a8-9fd65c823a99 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93" status: 404 len: 111 microversion: 2.1 time: 0.031270 Jun 22 17:17:41.470116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 573/1117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:41 2022] GET /compute/v2.1/servers/9330ca43-a83b-4245-9fda-575b4adf6d93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:17:42.681059 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:42.681602 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:42.687945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:42.688431 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:42.689190 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:42.689623 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:42.703119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 HTTP/1.1 Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:17:42.704661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.706389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13'} Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:42.707487 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.708966 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.710902 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:42.710902 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7bf12e80-834c-4fe0-9186-1f3657db6b53 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 404 len: 111 microversion: 2.1 time: 0.028746 Jun 22 17:17:42.710902 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 545/1118] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:17:42 2022] DELETE /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:17:42.714364 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:42.719905 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:42.721892 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:42.722340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:42.723097 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:42.723532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:42.737361 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 HTTP/1.1 Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:17:42.738884 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.740623 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13'} Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:42.741567 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. Jun 22 17:17:42.743192 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.744629 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:42.744629 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5b601bae-fafd-494f-8f24-7d0ba2c52e82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13" status: 404 len: 111 microversion: 2.1 time: 0.029763 Jun 22 17:17:42.744629 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 574/1119] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:42 2022] GET /compute/v2.1/servers/5ef5a748-cce0-4bb8-b7d1-3fb73eed5d13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:17:42.748734 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:42.754418 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:42.755189 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:42.755636 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:42.756427 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:42.756862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:42.770435 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b HTTP/1.1 Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:17:42.772043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.779465 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '62e797a3-004c-4a1c-a5a4-338724ef129b'} Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:42.780417 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.782176 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.783725 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:42.783725 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-33115ea9-4da1-4831-a264-978c065d2b82 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 404 len: 111 microversion: 2.1 time: 0.028503 Jun 22 17:17:42.783725 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 546/1120] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:17:42 2022] DELETE /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:17:42.783990 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:42.783990 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: 62e797a3-004c-4a1c-a5a4-338724ef129b] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:42.789121 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:42.789574 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:42.790342 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:42.790779 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:42.804226 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b HTTP/1.1 Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:17:42.805922 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.807581 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '62e797a3-004c-4a1c-a5a4-338724ef129b'} Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:42.808635 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. Jun 22 17:17:42.810172 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:42.811624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance 62e797a3-004c-4a1c-a5a4-338724ef129b could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:42.811624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0cfeeeba-f63e-4aab-8958-c1bc1bf9e7a3 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b" status: 404 len: 111 microversion: 2.1 time: 0.028647 Jun 22 17:17:42.811624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 575/1121] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:42 2022] GET /compute/v2.1/servers/62e797a3-004c-4a1c-a5a4-338724ef129b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:17:44.086086 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:44.086568 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:44.093004 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:44.093459 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:44.094220 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:44.094655 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:44.107571 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 HTTP/1.1 Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:17:44.109122 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.110733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': 'fcb371f6-ae21-429b-a7e4-d43500167025'} Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:44.111657 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.113256 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.114884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:44.114884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a9df9e14-2f6a-44e8-84b6-cf9750043108 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 404 len: 111 microversion: 2.1 time: 0.028188 Jun 22 17:17:44.114884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 547/1122] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:17:44 2022] DELETE /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:17:44.118755 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:17:44.119367 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] [instance: fcb371f6-ae21-429b-a7e4-d43500167025] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:17:44.126305 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:44.126750 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:44.127531 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:17:44.127939 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:17:44.141620 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] HTTP exception thrown: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Request method failure captured: Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 HTTP/1.1 Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis0zvK2wrlBqLItY5dDE9OJVkzg2bQsGIwUIvRkVQjebzbLxYIk2GaTgudR0K6fgHtsb0v7PI4_jsQ4qhtwmDmHhji8m5bKbELiXBI-VwvRMM7V6cavpHXHZEdfBMLUYfJObWA4NDVlVkyVaWX5ccjfMoBkNi3-p0sUUyFiUdhT9cTNU Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:17:44.143117 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_069840ebd26e434c861568668776df52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/069840ebd26e434c861568668776df52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/069840ebd26e434c861568668776df52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 069840ebd26e434c861568668776df52 Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2021937593 Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 05951aa9ba2344a994f9fa1aa6fdb3bf Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-AttachVolumeNegativeTest-2021937593-project Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.144766 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': 'fcb371f6-ae21-429b-a7e4-d43500167025'} Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:17:44.145698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. Jun 22 17:17:44.147371 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:17:44.148920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] Returning 404 to user: Instance fcb371f6-ae21-429b-a7e4-d43500167025 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:17:44.148920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-229447bf-a7da-48b1-a67f-9b67cf5a2851 tempest-AttachVolumeNegativeTest-2021937593 tempest-AttachVolumeNegativeTest-2021937593-project] 10.222.0.18 "GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025" status: 404 len: 111 microversion: 2.1 time: 0.029505 Jun 22 17:17:44.148920 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 576/1123] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:17:44 2022] GET /compute/v2.1/servers/fcb371f6-ae21-429b-a7e4-d43500167025 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:19:00.381644 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:19:00.382202 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:19:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:19:16.616923 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccd69a8d-8622-4985-acfd-eb40caa4ceff] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 17:19:16.617783 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:16.618506 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:16.622408 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b1f62297-31a5-4e3a-85f2-8fb1f1f0236d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:16.622903 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b1f62297-31a5-4e3a-85f2-8fb1f1f0236d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:16.629491 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b1f62297-31a5-4e3a-85f2-8fb1f1f0236d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:16.638979 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b1f62297-31a5-4e3a-85f2-8fb1f1f0236d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:16.638979 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b1f62297-31a5-4e3a-85f2-8fb1f1f0236d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:16.638979 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b1f62297-31a5-4e3a-85f2-8fb1f1f0236d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:16.656818 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b1f62297-31a5-4e3a-85f2-8fb1f1f0236d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:19:16.992515 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b1f62297-31a5-4e3a-85f2-8fb1f1f0236d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 204 len: 0 microversion: 2.1 time: 0.377341 Jun 22 17:19:17.000270 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 548/1124] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:19:16 2022] DELETE /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:19:17.005679 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:17.007756 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:17.012282 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-262ae6d2-f69e-46f4-be41-6f566924de34 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:17.012898 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-262ae6d2-f69e-46f4-be41-6f566924de34 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:17.018698 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-262ae6d2-f69e-46f4-be41-6f566924de34 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:17.019145 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-262ae6d2-f69e-46f4-be41-6f566924de34 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:17.019906 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-262ae6d2-f69e-46f4-be41-6f566924de34 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:17.020540 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-262ae6d2-f69e-46f4-be41-6f566924de34 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:17.311530 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-262ae6d2-f69e-46f4-be41-6f566924de34 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:17.319137 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-262ae6d2-f69e-46f4-be41-6f566924de34 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1575 microversion: 2.1 time: 0.315371 Jun 22 17:19:17.319689 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 577/1125] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:17 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1575 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:18.337073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8e124914-c78a-4929-b861-d26158c8b47b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:18.337738 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8e124914-c78a-4929-b861-d26158c8b47b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:18.345473 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e124914-c78a-4929-b861-d26158c8b47b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:18.345915 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e124914-c78a-4929-b861-d26158c8b47b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:18.346675 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e124914-c78a-4929-b861-d26158c8b47b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:18.347103 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e124914-c78a-4929-b861-d26158c8b47b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:18.352279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccd69a8d-8622-4985-acfd-eb40caa4ceff] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57892. Jun 22 17:19:18.527201 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8e124914-c78a-4929-b861-d26158c8b47b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:18.534692 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8e124914-c78a-4929-b861-d26158c8b47b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1575 microversion: 2.1 time: 0.201974 Jun 22 17:19:18.535245 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 549/1126] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:18 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:19.552798 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ff8e33e0-6a9b-4fa2-b8d7-aa3beb41d213 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:19.553419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ff8e33e0-6a9b-4fa2-b8d7-aa3beb41d213 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:19.560589 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff8e33e0-6a9b-4fa2-b8d7-aa3beb41d213 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:19.561042 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff8e33e0-6a9b-4fa2-b8d7-aa3beb41d213 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:19.561816 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff8e33e0-6a9b-4fa2-b8d7-aa3beb41d213 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:19.562259 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ff8e33e0-6a9b-4fa2-b8d7-aa3beb41d213 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:19.706868 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ff8e33e0-6a9b-4fa2-b8d7-aa3beb41d213 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:19.714524 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ff8e33e0-6a9b-4fa2-b8d7-aa3beb41d213 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1575 microversion: 2.1 time: 0.166458 Jun 22 17:19:19.715422 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 578/1127] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:19 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:20.350356 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-5f49bff9-91f2-41b7-b04c-cbbc87ff1d18 req-7e242195-43b9-480d-9379-128c8885025c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8000b1a5-9448-4b4b-bc6b-3006352c7796", "name": "network-vif-deleted", "tag": "46857e9b-715a-48b6-8e5b-6106495e8ef3"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:19:20.358878 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-5f49bff9-91f2-41b7-b04c-cbbc87ff1d18 req-7e242195-43b9-480d-9379-128c8885025c service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:20.359317 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-5f49bff9-91f2-41b7-b04c-cbbc87ff1d18 req-7e242195-43b9-480d-9379-128c8885025c service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:20.370593 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-5f49bff9-91f2-41b7-b04c-cbbc87ff1d18 req-7e242195-43b9-480d-9379-128c8885025c service nova] Creating event network-vif-deleted:46857e9b-715a-48b6-8e5b-6106495e8ef3 for instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 on hv-cinder-81045 Jun 22 17:19:20.375527 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-5f49bff9-91f2-41b7-b04c-cbbc87ff1d18 req-7e242195-43b9-480d-9379-128c8885025c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028859 Jun 22 17:19:20.376163 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 550/1128] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:19:20.734441 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a7aec8af-01b0-41d9-b5da-b9248b613cab tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:20.735047 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a7aec8af-01b0-41d9-b5da-b9248b613cab tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:20.741928 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a7aec8af-01b0-41d9-b5da-b9248b613cab tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:20.742376 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a7aec8af-01b0-41d9-b5da-b9248b613cab tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:20.743132 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a7aec8af-01b0-41d9-b5da-b9248b613cab tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:20.743560 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a7aec8af-01b0-41d9-b5da-b9248b613cab tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:20.808268 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a7aec8af-01b0-41d9-b5da-b9248b613cab tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:20.815900 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a7aec8af-01b0-41d9-b5da-b9248b613cab tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1508 microversion: 2.1 time: 0.085314 Jun 22 17:19:20.816716 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 579/1129] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:20 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1508 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:21.833158 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aa39b39a-2cfe-4be2-a70e-6d6a981df10d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:21.833785 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa39b39a-2cfe-4be2-a70e-6d6a981df10d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:21.840405 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa39b39a-2cfe-4be2-a70e-6d6a981df10d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:21.840855 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa39b39a-2cfe-4be2-a70e-6d6a981df10d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:21.841607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa39b39a-2cfe-4be2-a70e-6d6a981df10d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:21.842042 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa39b39a-2cfe-4be2-a70e-6d6a981df10d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:21.904231 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-aa39b39a-2cfe-4be2-a70e-6d6a981df10d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:21.912168 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aa39b39a-2cfe-4be2-a70e-6d6a981df10d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1508 microversion: 2.1 time: 0.083150 Jun 22 17:19:21.912729 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 551/1130] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:21 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1508 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:22.929743 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-a3b0ded8-afb4-4d27-bea9-45af4a730179 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:22.930320 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-a3b0ded8-afb4-4d27-bea9-45af4a730179 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:22.938498 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a3b0ded8-afb4-4d27-bea9-45af4a730179 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:22.939507 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a3b0ded8-afb4-4d27-bea9-45af4a730179 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:22.940317 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a3b0ded8-afb4-4d27-bea9-45af4a730179 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:22.940749 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-a3b0ded8-afb4-4d27-bea9-45af4a730179 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:23.004313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-a3b0ded8-afb4-4d27-bea9-45af4a730179 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:23.012416 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-a3b0ded8-afb4-4d27-bea9-45af4a730179 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1508 microversion: 2.1 time: 0.086642 Jun 22 17:19:23.012987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 580/1131] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:22 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1508 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:24.029562 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:24.030179 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:24.036809 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:24.037266 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:24.038035 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:24.038476 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:24.068421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:24.068874 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:24.069327 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lazy-loading 'fault' on Instance uuid 8000b1a5-9448-4b4b-bc6b-3006352c7796 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:19:24.111881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:24.119252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3109741d-78dd-4af0-ab76-a6fccc5cec53 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 200 len: 1230 microversion: 2.1 time: 0.093603 Jun 22 17:19:24.119806 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 552/1132] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:24 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:25.135836 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:25.136483 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:25.143482 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:25.143930 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:25.144732 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:25.145168 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:25.160327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] HTTP exception thrown: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Request method failure captured: Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 HTTP/1.1 Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis05Z6fM7NgNaZNxDFbU86eetYkXg0GDCwBsv4R89yLXE2B6YT0if3ruX_fCdUr7io7GvJNJBBe9krOzUGcrXRzQ58ghiGHc8qg1qZoFYjOJ8mHGYM28PT5q3mDNc6NV6QCfWGnGaKWcnkypBk-kUxj-VfxYsvUhazUX3ZhALwRSRC-M Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:19:25.161915 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 00da4e0bbeba4a1f954ea2d27ff18f59 Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:19:25.163809 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '8000b1a5-9448-4b4b-bc6b-3006352c7796'} Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:19:25.164999 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:19:25.166763 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:19:25.168433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Returning 404 to user: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:19:25.168433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5f2be8ff-a480-4ba9-9f2b-27a12d9fbc1a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 404 len: 111 microversion: 2.1 time: 0.031295 Jun 22 17:19:25.168433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 581/1133] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:25 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:19:25.262160 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1324352745", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-119335214", "security_groups": [{"name": "tempest-secgroup-smoke-470992051"}], "block_device_mapping_v2": [{"uuid": "79638335-18dd-4f41-b0d1-a767c5f0bcf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abd066b9-f80d-4516-83dc-19b016a13318"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:19:25.379513 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] validate_networks() for [('abd066b9-f80d-4516-83dc-19b016a13318', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:19:25.794155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:19:25.794599 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:19:25.795056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:19:25.795464 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:19:25.796184 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:19:25.805546 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:25.805971 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:25.806746 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:25.807186 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:25.824182 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Getting quotas for project 2c32a4df73e946b2844051778a16a8c0. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:19:25.828052 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Getting quotas for user 00da4e0bbeba4a1f954ea2d27ff18f59 and project 2c32a4df73e946b2844051778a16a8c0. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:19:25.884989 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:19:25.887195 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='79638335-18dd-4f41-b0d1-a767c5f0bcf0',volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:19:26.240350 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a4c3ead1-c695-48bd-bd81-7bee50709567 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.984019 Jun 22 17:19:26.241833 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 553/1134] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:19:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:19:26.250844 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0e7afe05-4f39-48c8-9046-693ac67e369f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:26.251506 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0e7afe05-4f39-48c8-9046-693ac67e369f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:26.309509 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0e7afe05-4f39-48c8-9046-693ac67e369f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:26.317368 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0e7afe05-4f39-48c8-9046-693ac67e369f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1094 microversion: 2.1 time: 0.070323 Jun 22 17:19:26.317925 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 582/1135] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:26 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:27.337076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1e0ce6c1-608a-4d2f-8bd6-2d4d3bd16b6c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:27.337076 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1e0ce6c1-608a-4d2f-8bd6-2d4d3bd16b6c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:27.349056 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e0ce6c1-608a-4d2f-8bd6-2d4d3bd16b6c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:27.349514 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e0ce6c1-608a-4d2f-8bd6-2d4d3bd16b6c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:27.350291 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e0ce6c1-608a-4d2f-8bd6-2d4d3bd16b6c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:27.350729 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e0ce6c1-608a-4d2f-8bd6-2d4d3bd16b6c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:27.412206 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1e0ce6c1-608a-4d2f-8bd6-2d4d3bd16b6c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:27.419548 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1e0ce6c1-608a-4d2f-8bd6-2d4d3bd16b6c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1144 microversion: 2.1 time: 0.089193 Jun 22 17:19:27.420154 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 554/1136] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:27 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:28.437110 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-ce55a2e9-66fc-42eb-8fbb-c1e739053ec8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:28.437718 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-ce55a2e9-66fc-42eb-8fbb-c1e739053ec8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:28.445013 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ce55a2e9-66fc-42eb-8fbb-c1e739053ec8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:28.445528 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ce55a2e9-66fc-42eb-8fbb-c1e739053ec8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:28.446282 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ce55a2e9-66fc-42eb-8fbb-c1e739053ec8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:28.446742 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-ce55a2e9-66fc-42eb-8fbb-c1e739053ec8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:28.512217 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-ce55a2e9-66fc-42eb-8fbb-c1e739053ec8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:28.520543 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-ce55a2e9-66fc-42eb-8fbb-c1e739053ec8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1200 microversion: 2.1 time: 0.087237 Jun 22 17:19:28.521127 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 583/1137] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:28 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:29.539541 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a53800b1-a2f9-4e50-a4b4-db9ea342ddf3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:29.540470 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a53800b1-a2f9-4e50-a4b4-db9ea342ddf3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:29.550228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a53800b1-a2f9-4e50-a4b4-db9ea342ddf3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:29.550836 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a53800b1-a2f9-4e50-a4b4-db9ea342ddf3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:29.552785 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a53800b1-a2f9-4e50-a4b4-db9ea342ddf3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:29.552785 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a53800b1-a2f9-4e50-a4b4-db9ea342ddf3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:29.725923 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a53800b1-a2f9-4e50-a4b4-db9ea342ddf3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:29.733601 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a53800b1-a2f9-4e50-a4b4-db9ea342ddf3 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1277 microversion: 2.1 time: 0.198649 Jun 22 17:19:29.734169 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 555/1138] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:29 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:29.971591 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:19:29.973691 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:19:30.077006 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-bb41c856-fc22-4e93-ae98-88b373563d47 req-5a27f870-0cbc-41f4-8a5c-a8a688071be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72295916-5bcf-49bd-84c7-499d248adff4", "tag": "81294489-c100-4e84-b180-78dfc6cf2164"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:19:30.090376 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-bb41c856-fc22-4e93-ae98-88b373563d47 req-5a27f870-0cbc-41f4-8a5c-a8a688071be1 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:30.090893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-bb41c856-fc22-4e93-ae98-88b373563d47 req-5a27f870-0cbc-41f4-8a5c-a8a688071be1 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:30.111308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-bb41c856-fc22-4e93-ae98-88b373563d47 req-5a27f870-0cbc-41f4-8a5c-a8a688071be1 service nova] Creating event network-changed:81294489-c100-4e84-b180-78dfc6cf2164 for instance 72295916-5bcf-49bd-84c7-499d248adff4 on hv-cinder-81045 Jun 22 17:19:30.116654 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-bb41c856-fc22-4e93-ae98-88b373563d47 req-5a27f870-0cbc-41f4-8a5c-a8a688071be1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048082 Jun 22 17:19:30.117262 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 584/1139] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:19:30.751369 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e42e64e9-a77c-4f7a-81f4-4957531e2038 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:30.752041 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e42e64e9-a77c-4f7a-81f4-4957531e2038 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:30.758398 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e42e64e9-a77c-4f7a-81f4-4957531e2038 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:30.758845 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e42e64e9-a77c-4f7a-81f4-4957531e2038 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:30.759602 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e42e64e9-a77c-4f7a-81f4-4957531e2038 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:30.760032 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e42e64e9-a77c-4f7a-81f4-4957531e2038 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:30.912005 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e42e64e9-a77c-4f7a-81f4-4957531e2038 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:30.919626 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e42e64e9-a77c-4f7a-81f4-4957531e2038 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.172634 Jun 22 17:19:30.920204 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 556/1140] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:30 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:31.937520 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-21e00288-6d12-4dc0-9b70-f9cd42358261 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:31.938214 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-21e00288-6d12-4dc0-9b70-f9cd42358261 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:31.944800 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-21e00288-6d12-4dc0-9b70-f9cd42358261 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:31.945244 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-21e00288-6d12-4dc0-9b70-f9cd42358261 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:31.945988 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-21e00288-6d12-4dc0-9b70-f9cd42358261 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:31.946419 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-21e00288-6d12-4dc0-9b70-f9cd42358261 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:32.080875 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-21e00288-6d12-4dc0-9b70-f9cd42358261 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:32.088630 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-21e00288-6d12-4dc0-9b70-f9cd42358261 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.155161 Jun 22 17:19:32.089781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 585/1141] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:31 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:33.106669 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7baa6037-9cf6-4398-bd0a-f532fb672548 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:33.107291 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7baa6037-9cf6-4398-bd0a-f532fb672548 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:33.114397 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7baa6037-9cf6-4398-bd0a-f532fb672548 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:33.114848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7baa6037-9cf6-4398-bd0a-f532fb672548 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:33.115607 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7baa6037-9cf6-4398-bd0a-f532fb672548 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:33.116041 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7baa6037-9cf6-4398-bd0a-f532fb672548 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:33.249905 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7baa6037-9cf6-4398-bd0a-f532fb672548 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:33.257330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7baa6037-9cf6-4398-bd0a-f532fb672548 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.154499 Jun 22 17:19:33.257881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 557/1142] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:33 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:34.274436 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-9cf78e48-abeb-423d-8826-df9830ddbf08 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:34.275042 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-9cf78e48-abeb-423d-8826-df9830ddbf08 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:34.281184 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9cf78e48-abeb-423d-8826-df9830ddbf08 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:34.281568 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9cf78e48-abeb-423d-8826-df9830ddbf08 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:34.282313 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9cf78e48-abeb-423d-8826-df9830ddbf08 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:34.282736 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-9cf78e48-abeb-423d-8826-df9830ddbf08 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:34.419158 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-9cf78e48-abeb-423d-8826-df9830ddbf08 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:34.427394 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-9cf78e48-abeb-423d-8826-df9830ddbf08 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.156904 Jun 22 17:19:34.427945 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 586/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:34 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:35.444058 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1f5de408-509f-4c58-ad58-c59eb1f84516 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:35.444690 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1f5de408-509f-4c58-ad58-c59eb1f84516 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:35.451503 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1f5de408-509f-4c58-ad58-c59eb1f84516 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:35.451945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1f5de408-509f-4c58-ad58-c59eb1f84516 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:35.453116 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1f5de408-509f-4c58-ad58-c59eb1f84516 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:35.453553 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1f5de408-509f-4c58-ad58-c59eb1f84516 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:35.585625 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1f5de408-509f-4c58-ad58-c59eb1f84516 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:35.592984 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1f5de408-509f-4c58-ad58-c59eb1f84516 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.152746 Jun 22 17:19:35.593540 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 558/1144] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:35 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:36.609602 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b8cf6e85-b542-47bc-af5b-f19849be975a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:36.610153 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b8cf6e85-b542-47bc-af5b-f19849be975a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:36.612603 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=2 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:36.617545 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8cf6e85-b542-47bc-af5b-f19849be975a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:36.618003 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8cf6e85-b542-47bc-af5b-f19849be975a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:36.618764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8cf6e85-b542-47bc-af5b-f19849be975a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:36.619203 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b8cf6e85-b542-47bc-af5b-f19849be975a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:36.748402 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b8cf6e85-b542-47bc-af5b-f19849be975a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:36.756343 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b8cf6e85-b542-47bc-af5b-f19849be975a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.150716 Jun 22 17:19:36.756903 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 587/1145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:36 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:37.772800 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-91bf3f38-2a93-4217-82c3-445dbc207697 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:37.773421 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-91bf3f38-2a93-4217-82c3-445dbc207697 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:37.775201 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:37.775850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:37.781218 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-91bf3f38-2a93-4217-82c3-445dbc207697 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:37.781667 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-91bf3f38-2a93-4217-82c3-445dbc207697 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:37.782422 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-91bf3f38-2a93-4217-82c3-445dbc207697 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:37.782856 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-91bf3f38-2a93-4217-82c3-445dbc207697 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:37.910868 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-91bf3f38-2a93-4217-82c3-445dbc207697 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:37.918133 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-91bf3f38-2a93-4217-82c3-445dbc207697 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.149443 Jun 22 17:19:37.918676 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 559/1146] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:37 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:38.935222 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-eeb48bc5-5b3f-4e41-8ff6-a08c4e4e114a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:38.935896 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-eeb48bc5-5b3f-4e41-8ff6-a08c4e4e114a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:38.942839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eeb48bc5-5b3f-4e41-8ff6-a08c4e4e114a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:38.943289 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eeb48bc5-5b3f-4e41-8ff6-a08c4e4e114a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:38.944052 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eeb48bc5-5b3f-4e41-8ff6-a08c4e4e114a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:38.944529 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eeb48bc5-5b3f-4e41-8ff6-a08c4e4e114a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:39.074644 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-eeb48bc5-5b3f-4e41-8ff6-a08c4e4e114a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:39.082893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-eeb48bc5-5b3f-4e41-8ff6-a08c4e4e114a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.151533 Jun 22 17:19:39.083454 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 588/1147] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:38 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:40.098706 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d69cb6b7-b5ce-411b-9ccd-4b204caf3c9e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:40.099415 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d69cb6b7-b5ce-411b-9ccd-4b204caf3c9e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:40.105772 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d69cb6b7-b5ce-411b-9ccd-4b204caf3c9e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:40.106219 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d69cb6b7-b5ce-411b-9ccd-4b204caf3c9e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:40.106980 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d69cb6b7-b5ce-411b-9ccd-4b204caf3c9e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:40.107412 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d69cb6b7-b5ce-411b-9ccd-4b204caf3c9e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:40.242012 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d69cb6b7-b5ce-411b-9ccd-4b204caf3c9e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:40.249416 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d69cb6b7-b5ce-411b-9ccd-4b204caf3c9e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.154541 Jun 22 17:19:40.259250 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 560/1148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:40 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:40.473470 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-93a29421-fe5f-41a9-b23f-e5aa29223b23 req-89b46bd2-f3c0-4f17-bb39-28f95b74ce0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72295916-5bcf-49bd-84c7-499d248adff4", "name": "network-vif-plugged", "status": "completed", "tag": "81294489-c100-4e84-b180-78dfc6cf2164"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:19:40.481401 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-93a29421-fe5f-41a9-b23f-e5aa29223b23 req-89b46bd2-f3c0-4f17-bb39-28f95b74ce0a service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:40.481839 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-93a29421-fe5f-41a9-b23f-e5aa29223b23 req-89b46bd2-f3c0-4f17-bb39-28f95b74ce0a service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:40.492781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-93a29421-fe5f-41a9-b23f-e5aa29223b23 req-89b46bd2-f3c0-4f17-bb39-28f95b74ce0a service nova] Creating event network-vif-plugged:81294489-c100-4e84-b180-78dfc6cf2164 for instance 72295916-5bcf-49bd-84c7-499d248adff4 on hv-cinder-81045 Jun 22 17:19:40.497682 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-93a29421-fe5f-41a9-b23f-e5aa29223b23 req-89b46bd2-f3c0-4f17-bb39-28f95b74ce0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203224 Jun 22 17:19:40.498245 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 589/1149] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:19:41.267494 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e9e4beea-dea0-4251-8432-faa63ec5c3c8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:41.268068 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e9e4beea-dea0-4251-8432-faa63ec5c3c8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:41.274454 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9e4beea-dea0-4251-8432-faa63ec5c3c8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:41.274910 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9e4beea-dea0-4251-8432-faa63ec5c3c8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:41.275698 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9e4beea-dea0-4251-8432-faa63ec5c3c8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:41.276157 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9e4beea-dea0-4251-8432-faa63ec5c3c8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:41.409511 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e9e4beea-dea0-4251-8432-faa63ec5c3c8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:41.416830 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e9e4beea-dea0-4251-8432-faa63ec5c3c8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1265 microversion: 2.1 time: 0.153878 Jun 22 17:19:41.419615 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 561/1150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:41 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:42.434918 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-87580e90-98ef-413f-acbb-d2d90fe5fff8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:42.435618 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-87580e90-98ef-413f-acbb-d2d90fe5fff8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:42.441835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-87580e90-98ef-413f-acbb-d2d90fe5fff8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:42.442285 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-87580e90-98ef-413f-acbb-d2d90fe5fff8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:42.443038 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-87580e90-98ef-413f-acbb-d2d90fe5fff8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:42.443469 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-87580e90-98ef-413f-acbb-d2d90fe5fff8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:42.577189 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-87580e90-98ef-413f-acbb-d2d90fe5fff8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:42.585413 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-87580e90-98ef-413f-acbb-d2d90fe5fff8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1450 microversion: 2.1 time: 0.155162 Jun 22 17:19:42.589014 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 590/1151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:42 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:42.603132 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7dce1b35-1077-40f5-958b-0329a05568de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:19:42.603891 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7dce1b35-1077-40f5-958b-0329a05568de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:19:42.610371 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7dce1b35-1077-40f5-958b-0329a05568de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:42.610801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7dce1b35-1077-40f5-958b-0329a05568de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:42.611733 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7dce1b35-1077-40f5-958b-0329a05568de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:42.612200 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7dce1b35-1077-40f5-958b-0329a05568de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:42.743475 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7dce1b35-1077-40f5-958b-0329a05568de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:19:42.751415 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7dce1b35-1077-40f5-958b-0329a05568de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1450 microversion: 2.1 time: 0.151629 Jun 22 17:19:42.751971 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 562/1152] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:19:42 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:19:44.569720 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-6a6fe1f8-2a72-4e50-948b-7f09d6d2d704 req-cb2cf2b7-a903-43a5-8fb6-a61b728ab722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72295916-5bcf-49bd-84c7-499d248adff4", "tag": "81294489-c100-4e84-b180-78dfc6cf2164"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:19:44.578024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-6a6fe1f8-2a72-4e50-948b-7f09d6d2d704 req-cb2cf2b7-a903-43a5-8fb6-a61b728ab722 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:19:44.578472 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-6a6fe1f8-2a72-4e50-948b-7f09d6d2d704 req-cb2cf2b7-a903-43a5-8fb6-a61b728ab722 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:19:44.589525 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-6a6fe1f8-2a72-4e50-948b-7f09d6d2d704 req-cb2cf2b7-a903-43a5-8fb6-a61b728ab722 service nova] Creating event network-changed:81294489-c100-4e84-b180-78dfc6cf2164 for instance 72295916-5bcf-49bd-84c7-499d248adff4 on hv-cinder-81045 Jun 22 17:19:44.594523 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-6a6fe1f8-2a72-4e50-948b-7f09d6d2d704 req-cb2cf2b7-a903-43a5-8fb6-a61b728ab722 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028440 Jun 22 17:19:44.602136 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 591/1153] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:20:40.068433 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 22 17:20:40.069059 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:20:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:20:58.211206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:20:58.212010 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:20:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:21:44.777205 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:21:44.777944 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:21:44.782279 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1218398971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-119335214", "security_groups": [{"name": "tempest-secgroup-smoke-470992051"}], "block_device_mapping_v2": [{"uuid": "d15acedd-4726-4756-b31e-8873cb370cb9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abd066b9-f80d-4516-83dc-19b016a13318"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:21:44.897124 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] validate_networks() for [('abd066b9-f80d-4516-83dc-19b016a13318', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 17:21:45.289299 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 17:21:45.289463 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 17:21:45.289794 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 17:21:45.290192 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 17:21:45.290597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 17:21:45.300154 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:45.300599 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:45.301385 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:45.301815 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:45.318045 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Getting quotas for project 2c32a4df73e946b2844051778a16a8c0. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 17:21:45.321618 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Getting quotas for user 00da4e0bbeba4a1f954ea2d27ff18f59 and project 2c32a4df73e946b2844051778a16a8c0. Resources: {'instances', 'cores', 'ram'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 17:21:45.376612 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 17:21:45.378658 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d15acedd-4726-4756-b31e-8873cb370cb9',volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 17:21:45.798308 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e097be79-f199-4278-be6a-b4ede0ed8a59 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.022746 Jun 22 17:21:45.799003 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 563/1154] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 17:21:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 17:21:45.806993 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cede6ca6-33c9-482b-952b-295f5b7d41b3] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 22 17:21:45.807594 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=32 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:21:45.808380 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=68 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:21:45.813236 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-1c3ce9c9-e485-4214-8f6a-2fcea4866ac0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:45.820493 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-1c3ce9c9-e485-4214-8f6a-2fcea4866ac0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:45.870641 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-1c3ce9c9-e485-4214-8f6a-2fcea4866ac0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:45.878024 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-1c3ce9c9-e485-4214-8f6a-2fcea4866ac0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1094 microversion: 2.1 time: 0.072860 Jun 22 17:21:45.878577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 592/1155] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:45 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:46.895073 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f6140f18-dec4-49d7-850b-82024d3aed54 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:46.895723 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f6140f18-dec4-49d7-850b-82024d3aed54 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:46.950945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f6140f18-dec4-49d7-850b-82024d3aed54 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:46.957829 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f6140f18-dec4-49d7-850b-82024d3aed54 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1094 microversion: 2.1 time: 0.067009 Jun 22 17:21:46.958461 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 564/1156] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:46 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:47.976093 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-d8f06f47-54f4-420c-8945-1df673d8da56 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:47.976706 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-d8f06f47-54f4-420c-8945-1df673d8da56 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:47.987589 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] [cede6ca6-33c9-482b-952b-295f5b7d41b3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58126. Jun 22 17:21:48.038767 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-d8f06f47-54f4-420c-8945-1df673d8da56 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:48.046055 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-d8f06f47-54f4-420c-8945-1df673d8da56 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1094 microversion: 2.1 time: 0.074691 Jun 22 17:21:48.046640 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 593/1157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:47 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:49.063537 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-25e06b0a-620b-4a68-a9e2-71e0a58f5a89 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:49.064177 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-25e06b0a-620b-4a68-a9e2-71e0a58f5a89 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:49.361745 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-25e06b0a-620b-4a68-a9e2-71e0a58f5a89 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:49.368985 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-25e06b0a-620b-4a68-a9e2-71e0a58f5a89 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1094 microversion: 2.1 time: 0.310000 Jun 22 17:21:49.369528 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 565/1158] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:49 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1094 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:50.386382 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5fa87469-cc71-4c47-9c0f-957000ad8270 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:50.386992 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5fa87469-cc71-4c47-9c0f-957000ad8270 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:50.395148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5fa87469-cc71-4c47-9c0f-957000ad8270 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:50.395598 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5fa87469-cc71-4c47-9c0f-957000ad8270 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:50.396397 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5fa87469-cc71-4c47-9c0f-957000ad8270 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:50.396835 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5fa87469-cc71-4c47-9c0f-957000ad8270 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:50.456429 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-5fa87469-cc71-4c47-9c0f-957000ad8270 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:50.463658 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5fa87469-cc71-4c47-9c0f-957000ad8270 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1144 microversion: 2.1 time: 0.081159 Jun 22 17:21:50.464238 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 594/1159] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:50 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:51.480506 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-09b13c24-4d5b-43dc-8c91-a656d0a6ab7f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:51.481140 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-09b13c24-4d5b-43dc-8c91-a656d0a6ab7f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:51.487506 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-09b13c24-4d5b-43dc-8c91-a656d0a6ab7f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:51.487957 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-09b13c24-4d5b-43dc-8c91-a656d0a6ab7f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:51.488751 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-09b13c24-4d5b-43dc-8c91-a656d0a6ab7f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:51.489186 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-09b13c24-4d5b-43dc-8c91-a656d0a6ab7f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:51.548869 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-09b13c24-4d5b-43dc-8c91-a656d0a6ab7f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:51.556309 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-09b13c24-4d5b-43dc-8c91-a656d0a6ab7f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1192 microversion: 2.1 time: 0.079709 Jun 22 17:21:51.556868 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 566/1160] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:51 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1192 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:52.573273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fb47616c-9c03-4aee-a02f-2dfaa9f6a3de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:52.573888 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fb47616c-9c03-4aee-a02f-2dfaa9f6a3de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:52.580995 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fb47616c-9c03-4aee-a02f-2dfaa9f6a3de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:52.581385 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fb47616c-9c03-4aee-a02f-2dfaa9f6a3de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:52.582148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fb47616c-9c03-4aee-a02f-2dfaa9f6a3de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:52.582580 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fb47616c-9c03-4aee-a02f-2dfaa9f6a3de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:52.646775 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fb47616c-9c03-4aee-a02f-2dfaa9f6a3de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:52.655120 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fb47616c-9c03-4aee-a02f-2dfaa9f6a3de tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1210 microversion: 2.1 time: 0.085190 Jun 22 17:21:52.655899 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 595/1161] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:52 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:53.671731 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0acb6c90-ed6a-493f-b3b6-0ba026738309 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:53.672573 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0acb6c90-ed6a-493f-b3b6-0ba026738309 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:53.679020 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0acb6c90-ed6a-493f-b3b6-0ba026738309 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:53.679783 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0acb6c90-ed6a-493f-b3b6-0ba026738309 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:53.680246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0acb6c90-ed6a-493f-b3b6-0ba026738309 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:53.680682 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0acb6c90-ed6a-493f-b3b6-0ba026738309 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:53.798312 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-5a6fa100-3d3a-45bf-b2c2-d68385f7c6cb req-22667839-9443-4c8a-b32b-3a4cece9c05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d86f9d-2d4a-4935-961f-457a74bb5968", "tag": "e0b8f928-6ade-4cf9-9fdc-8a8cb040d865"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:21:53.807449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-5a6fa100-3d3a-45bf-b2c2-d68385f7c6cb req-22667839-9443-4c8a-b32b-3a4cece9c05e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:53.807899 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-5a6fa100-3d3a-45bf-b2c2-d68385f7c6cb req-22667839-9443-4c8a-b32b-3a4cece9c05e service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:53.820201 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-5a6fa100-3d3a-45bf-b2c2-d68385f7c6cb req-22667839-9443-4c8a-b32b-3a4cece9c05e service nova] Creating event network-changed:e0b8f928-6ade-4cf9-9fdc-8a8cb040d865 for instance a1d86f9d-2d4a-4935-961f-457a74bb5968 on hv-cinder-81045 Jun 22 17:21:53.825761 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-5a6fa100-3d3a-45bf-b2c2-d68385f7c6cb req-22667839-9443-4c8a-b32b-3a4cece9c05e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099658 Jun 22 17:21:53.829036 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 596/1162] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 17:21:53.866967 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0acb6c90-ed6a-493f-b3b6-0ba026738309 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:53.875757 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0acb6c90-ed6a-493f-b3b6-0ba026738309 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.207838 Jun 22 17:21:53.876303 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 567/1163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:53 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:54.894791 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-392f5ef0-b452-42d3-bb13-436d225188c6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:54.895494 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-392f5ef0-b452-42d3-bb13-436d225188c6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:54.901650 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-392f5ef0-b452-42d3-bb13-436d225188c6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:54.902095 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-392f5ef0-b452-42d3-bb13-436d225188c6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:54.902847 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-392f5ef0-b452-42d3-bb13-436d225188c6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:54.903279 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-392f5ef0-b452-42d3-bb13-436d225188c6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:55.037198 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-392f5ef0-b452-42d3-bb13-436d225188c6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:55.044579 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-392f5ef0-b452-42d3-bb13-436d225188c6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.154440 Jun 22 17:21:55.045139 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 597/1164] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:54 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:56.061909 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-42fc440b-60c0-4f54-b736-45b3a356711f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:56.062523 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-42fc440b-60c0-4f54-b736-45b3a356711f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:56.064848 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:21:56.069692 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42fc440b-60c0-4f54-b736-45b3a356711f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:56.071468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42fc440b-60c0-4f54-b736-45b3a356711f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:56.071468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42fc440b-60c0-4f54-b736-45b3a356711f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:56.071468 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42fc440b-60c0-4f54-b736-45b3a356711f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:56.203611 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-42fc440b-60c0-4f54-b736-45b3a356711f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:56.211132 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-42fc440b-60c0-4f54-b736-45b3a356711f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.153306 Jun 22 17:21:56.211693 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 568/1165] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:56 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:57.228446 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-0efc4f04-cc80-4be9-8aca-03f51cacdf2c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:57.229092 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-0efc4f04-cc80-4be9-8aca-03f51cacdf2c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:57.235576 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0efc4f04-cc80-4be9-8aca-03f51cacdf2c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:57.236026 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0efc4f04-cc80-4be9-8aca-03f51cacdf2c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:57.236820 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0efc4f04-cc80-4be9-8aca-03f51cacdf2c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:57.237258 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-0efc4f04-cc80-4be9-8aca-03f51cacdf2c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:57.364194 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-0efc4f04-cc80-4be9-8aca-03f51cacdf2c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:57.371586 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-0efc4f04-cc80-4be9-8aca-03f51cacdf2c tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.147125 Jun 22 17:21:57.372156 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 598/1166] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:57 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:58.389496 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c09d2b2b-2d9c-4510-8357-5a17155ec19a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:58.390108 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c09d2b2b-2d9c-4510-8357-5a17155ec19a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:58.396642 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c09d2b2b-2d9c-4510-8357-5a17155ec19a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:58.397091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c09d2b2b-2d9c-4510-8357-5a17155ec19a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:58.397850 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c09d2b2b-2d9c-4510-8357-5a17155ec19a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:58.398286 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c09d2b2b-2d9c-4510-8357-5a17155ec19a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:58.529555 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c09d2b2b-2d9c-4510-8357-5a17155ec19a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:58.536831 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c09d2b2b-2d9c-4510-8357-5a17155ec19a tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.151771 Jun 22 17:21:58.537389 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 569/1167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:58 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:21:59.553624 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-fb284d8a-0214-47cb-8ba8-268cc317b031 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:21:59.554229 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-fb284d8a-0214-47cb-8ba8-268cc317b031 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:21:59.556228 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell0:SELECT=4 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:21:59.561410 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fb284d8a-0214-47cb-8ba8-268cc317b031 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:59.561855 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fb284d8a-0214-47cb-8ba8-268cc317b031 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:59.562602 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fb284d8a-0214-47cb-8ba8-268cc317b031 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:21:59.563027 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-fb284d8a-0214-47cb-8ba8-268cc317b031 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:21:59.695241 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-fb284d8a-0214-47cb-8ba8-268cc317b031 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:21:59.702746 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-fb284d8a-0214-47cb-8ba8-268cc317b031 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.152984 Jun 22 17:21:59.703294 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 599/1168] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:21:59 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:00.719223 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5dd1a776-f9bd-4b5c-9e82-bd5be5cd35fc tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:22:00.719865 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5dd1a776-f9bd-4b5c-9e82-bd5be5cd35fc tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:22:00.721731 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=10 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:22:00.727034 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5dd1a776-f9bd-4b5c-9e82-bd5be5cd35fc tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:00.727478 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5dd1a776-f9bd-4b5c-9e82-bd5be5cd35fc tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:00.728264 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5dd1a776-f9bd-4b5c-9e82-bd5be5cd35fc tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:00.728699 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5dd1a776-f9bd-4b5c-9e82-bd5be5cd35fc tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:00.854680 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5dd1a776-f9bd-4b5c-9e82-bd5be5cd35fc tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:22:00.862564 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5dd1a776-f9bd-4b5c-9e82-bd5be5cd35fc tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.147311 Jun 22 17:22:00.863119 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 570/1169] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:22:00 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:01.880924 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-48d43f60-0572-4453-9246-f2da67fc01fa tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:22:01.881534 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-48d43f60-0572-4453-9246-f2da67fc01fa tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:22:01.887975 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-48d43f60-0572-4453-9246-f2da67fc01fa tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:01.889076 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-48d43f60-0572-4453-9246-f2da67fc01fa tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:01.889868 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-48d43f60-0572-4453-9246-f2da67fc01fa tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:01.890302 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-48d43f60-0572-4453-9246-f2da67fc01fa tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:02.273025 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-48d43f60-0572-4453-9246-f2da67fc01fa tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:22:02.281299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-48d43f60-0572-4453-9246-f2da67fc01fa tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.404252 Jun 22 17:22:02.281943 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 600/1170] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:22:01 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:03.298925 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c5940638-ed77-401e-99a0-56bb23249ae4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:22:03.299540 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c5940638-ed77-401e-99a0-56bb23249ae4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:22:03.306061 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5940638-ed77-401e-99a0-56bb23249ae4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:03.306516 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5940638-ed77-401e-99a0-56bb23249ae4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:03.307493 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5940638-ed77-401e-99a0-56bb23249ae4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:03.308043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5940638-ed77-401e-99a0-56bb23249ae4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:03.441633 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5940638-ed77-401e-99a0-56bb23249ae4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:22:03.449438 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c5940638-ed77-401e-99a0-56bb23249ae4 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.155152 Jun 22 17:22:03.450210 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 571/1171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:22:03 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:04.466968 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-f1e8e1fd-df0c-4256-bcf6-bc3d295f4b60 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:22:04.467592 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-f1e8e1fd-df0c-4256-bcf6-bc3d295f4b60 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:22:04.474832 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f1e8e1fd-df0c-4256-bcf6-bc3d295f4b60 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:04.475278 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f1e8e1fd-df0c-4256-bcf6-bc3d295f4b60 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:04.476043 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f1e8e1fd-df0c-4256-bcf6-bc3d295f4b60 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:04.476496 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-f1e8e1fd-df0c-4256-bcf6-bc3d295f4b60 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:04.604336 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-f1e8e1fd-df0c-4256-bcf6-bc3d295f4b60 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:22:04.612224 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-f1e8e1fd-df0c-4256-bcf6-bc3d295f4b60 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.149764 Jun 22 17:22:04.612778 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 601/1172] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:22:04 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:05.015011 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-1e53879b-62ac-4848-af9d-ea6a906c5ac7 req-f2890a18-b49d-4a0a-ab21-84f6ad3f7c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d86f9d-2d4a-4935-961f-457a74bb5968", "name": "network-vif-plugged", "status": "completed", "tag": "e0b8f928-6ade-4cf9-9fdc-8a8cb040d865"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:22:05.023769 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1e53879b-62ac-4848-af9d-ea6a906c5ac7 req-f2890a18-b49d-4a0a-ab21-84f6ad3f7c98 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:05.024234 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1e53879b-62ac-4848-af9d-ea6a906c5ac7 req-f2890a18-b49d-4a0a-ab21-84f6ad3f7c98 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:05.035704 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-1e53879b-62ac-4848-af9d-ea6a906c5ac7 req-f2890a18-b49d-4a0a-ab21-84f6ad3f7c98 service nova] Creating event network-vif-plugged:e0b8f928-6ade-4cf9-9fdc-8a8cb040d865 for instance a1d86f9d-2d4a-4935-961f-457a74bb5968 on hv-cinder-81045 Jun 22 17:22:05.040900 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-1e53879b-62ac-4848-af9d-ea6a906c5ac7 req-f2890a18-b49d-4a0a-ab21-84f6ad3f7c98 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030187 Jun 22 17:22:05.041551 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 572/1173] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:22:05.628532 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c9b7b637-845b-4cac-a297-9b0718a9b325 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:22:05.629150 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c9b7b637-845b-4cac-a297-9b0718a9b325 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:22:05.635584 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c9b7b637-845b-4cac-a297-9b0718a9b325 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:05.636032 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c9b7b637-845b-4cac-a297-9b0718a9b325 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:05.636821 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c9b7b637-845b-4cac-a297-9b0718a9b325 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:05.637256 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c9b7b637-845b-4cac-a297-9b0718a9b325 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:05.765450 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-c9b7b637-845b-4cac-a297-9b0718a9b325 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:22:05.772764 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c9b7b637-845b-4cac-a297-9b0718a9b325 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.148051 Jun 22 17:22:05.773327 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 602/1174] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:22:05 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:06.791060 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-12688449-a3d3-47cf-9f98-ead2c427f353 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:22:06.791771 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-12688449-a3d3-47cf-9f98-ead2c427f353 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:22:06.798663 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12688449-a3d3-47cf-9f98-ead2c427f353 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:06.799106 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12688449-a3d3-47cf-9f98-ead2c427f353 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:06.799858 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12688449-a3d3-47cf-9f98-ead2c427f353 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:06.800316 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12688449-a3d3-47cf-9f98-ead2c427f353 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:06.936155 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-12688449-a3d3-47cf-9f98-ead2c427f353 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:22:06.943681 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-12688449-a3d3-47cf-9f98-ead2c427f353 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1265 microversion: 2.1 time: 0.157354 Jun 22 17:22:06.944343 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 573/1175] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:22:06 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:07.960456 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-b1d690a5-0255-404b-adcb-bd5056cdd494 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:22:07.961065 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-b1d690a5-0255-404b-adcb-bd5056cdd494 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:22:07.967990 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1d690a5-0255-404b-adcb-bd5056cdd494 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:07.968474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1d690a5-0255-404b-adcb-bd5056cdd494 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:07.969220 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1d690a5-0255-404b-adcb-bd5056cdd494 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:07.969648 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-b1d690a5-0255-404b-adcb-bd5056cdd494 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:08.099235 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-b1d690a5-0255-404b-adcb-bd5056cdd494 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:22:08.106719 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-b1d690a5-0255-404b-adcb-bd5056cdd494 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1451 microversion: 2.1 time: 0.150090 Jun 22 17:22:08.107871 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 603/1176] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:22:07 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:08.122945 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8b672297-c3f5-4bd5-8c0f-00e7b7a270ea tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:22:08.123566 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8b672297-c3f5-4bd5-8c0f-00e7b7a270ea tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:22:08.129930 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8b672297-c3f5-4bd5-8c0f-00e7b7a270ea tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:08.130384 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8b672297-c3f5-4bd5-8c0f-00e7b7a270ea tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:08.131149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8b672297-c3f5-4bd5-8c0f-00e7b7a270ea tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:08.131590 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8b672297-c3f5-4bd5-8c0f-00e7b7a270ea tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:08.258777 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8b672297-c3f5-4bd5-8c0f-00e7b7a270ea tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:22:08.266674 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8b672297-c3f5-4bd5-8c0f-00e7b7a270ea tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1451 microversion: 2.1 time: 0.147529 Jun 22 17:22:08.267233 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 574/1177] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:22:08 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:22:10.318739 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-cc0a05f8-7f5a-4e50-86dd-ef9947aae350 req-bad17847-68a2-4e79-8ae9-fd67461ae88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d86f9d-2d4a-4935-961f-457a74bb5968", "tag": "e0b8f928-6ade-4cf9-9fdc-8a8cb040d865"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:22:10.327273 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-cc0a05f8-7f5a-4e50-86dd-ef9947aae350 req-bad17847-68a2-4e79-8ae9-fd67461ae88d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:22:10.327713 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-cc0a05f8-7f5a-4e50-86dd-ef9947aae350 req-bad17847-68a2-4e79-8ae9-fd67461ae88d service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:22:10.338533 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-cc0a05f8-7f5a-4e50-86dd-ef9947aae350 req-bad17847-68a2-4e79-8ae9-fd67461ae88d service nova] Creating event network-changed:e0b8f928-6ade-4cf9-9fdc-8a8cb040d865 for instance a1d86f9d-2d4a-4935-961f-457a74bb5968 on hv-cinder-81045 Jun 22 17:22:10.344079 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-cc0a05f8-7f5a-4e50-86dd-ef9947aae350 req-bad17847-68a2-4e79-8ae9-fd67461ae88d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029192 Jun 22 17:22:10.344711 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 604/1178] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:22:49.980252 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:22:49.980884 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:22:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:23:51.595211 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:23:51.596299 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=52 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:23:51.597708 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cede6ca6-33c9-482b-952b-295f5b7d41b3] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 22 17:23:51.598998 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_api:SELECT=30 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:23:51.599849 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG dbcounter [-] [118471] Writing DB stats nova_cell1:SELECT=58 {{(pid=118471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:23:51.604962 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-5e67786e-662d-43bc-9433-941f00521ea0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:23:51.605423 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5e67786e-662d-43bc-9433-941f00521ea0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:23:51.612146 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5e67786e-662d-43bc-9433-941f00521ea0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:51.612593 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5e67786e-662d-43bc-9433-941f00521ea0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:51.613381 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5e67786e-662d-43bc-9433-941f00521ea0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:51.613867 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-5e67786e-662d-43bc-9433-941f00521ea0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:51.643119 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-5e67786e-662d-43bc-9433-941f00521ea0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Going to try to terminate instance {{(pid=118471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:23:51.710489 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-e96576b6-15df-4ed3-abd1-0a004adb534d req-7ac8c3de-72ba-4379-91aa-d1cd550db4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d86f9d-2d4a-4935-961f-457a74bb5968", "tag": "e0b8f928-6ade-4cf9-9fdc-8a8cb040d865"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:23:51.718300 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-e96576b6-15df-4ed3-abd1-0a004adb534d req-7ac8c3de-72ba-4379-91aa-d1cd550db4a7 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:51.718745 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-e96576b6-15df-4ed3-abd1-0a004adb534d req-7ac8c3de-72ba-4379-91aa-d1cd550db4a7 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:51.730385 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-e96576b6-15df-4ed3-abd1-0a004adb534d req-7ac8c3de-72ba-4379-91aa-d1cd550db4a7 service nova] Creating event network-changed:e0b8f928-6ade-4cf9-9fdc-8a8cb040d865 for instance a1d86f9d-2d4a-4935-961f-457a74bb5968 on hv-cinder-81045 Jun 22 17:23:51.735724 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-e96576b6-15df-4ed3-abd1-0a004adb534d req-7ac8c3de-72ba-4379-91aa-d1cd550db4a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144126 Jun 22 17:23:51.736343 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 575/1179] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:23:51.964037 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-5e67786e-662d-43bc-9433-941f00521ea0 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 204 len: 0 microversion: 2.1 time: 0.368664 Jun 22 17:23:51.967875 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 605/1180] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:23:51 2022] DELETE /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 17:23:51.977744 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8e67843b-5208-4a7d-8b3e-c5062a362e4e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:23:51.983802 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8e67843b-5208-4a7d-8b3e-c5062a362e4e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:23:51.985605 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e67843b-5208-4a7d-8b3e-c5062a362e4e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:51.986065 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e67843b-5208-4a7d-8b3e-c5062a362e4e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:51.986843 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e67843b-5208-4a7d-8b3e-c5062a362e4e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:51.987285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8e67843b-5208-4a7d-8b3e-c5062a362e4e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:52.128500 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8e67843b-5208-4a7d-8b3e-c5062a362e4e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:23:52.136714 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8e67843b-5208-4a7d-8b3e-c5062a362e4e tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1576 microversion: 2.1 time: 0.163913 Jun 22 17:23:52.137370 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 576/1181] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:23:51 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:23:53.155298 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-03ffdd06-a2ad-4a14-82f4-76d1a3fc6185 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:23:53.156064 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-03ffdd06-a2ad-4a14-82f4-76d1a3fc6185 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:23:53.166933 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] [cede6ca6-33c9-482b-952b-295f5b7d41b3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58238. Jun 22 17:23:53.171157 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-03ffdd06-a2ad-4a14-82f4-76d1a3fc6185 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:53.171601 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-03ffdd06-a2ad-4a14-82f4-76d1a3fc6185 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:53.172387 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-03ffdd06-a2ad-4a14-82f4-76d1a3fc6185 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:53.172816 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-03ffdd06-a2ad-4a14-82f4-76d1a3fc6185 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:53.306373 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-03ffdd06-a2ad-4a14-82f4-76d1a3fc6185 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:23:53.314991 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-03ffdd06-a2ad-4a14-82f4-76d1a3fc6185 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1576 microversion: 2.1 time: 0.163903 Jun 22 17:23:53.315604 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 606/1182] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:23:53 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:23:54.332862 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ee90e40c-e418-43c4-af9f-6d34360eef1d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:23:54.333437 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ee90e40c-e418-43c4-af9f-6d34360eef1d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:23:54.339823 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee90e40c-e418-43c4-af9f-6d34360eef1d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:54.340302 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee90e40c-e418-43c4-af9f-6d34360eef1d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:54.341051 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee90e40c-e418-43c4-af9f-6d34360eef1d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:54.341476 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee90e40c-e418-43c4-af9f-6d34360eef1d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:54.419695 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ee90e40c-e418-43c4-af9f-6d34360eef1d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:23:54.428203 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ee90e40c-e418-43c4-af9f-6d34360eef1d tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1390 microversion: 2.1 time: 0.099236 Jun 22 17:23:54.428778 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 577/1183] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:23:54 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:23:54.504047 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-72824904-914c-4e67-83d8-81edf14b1aa2 req-653fe98a-bf9e-4f10-aa8b-6aa4644de9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d86f9d-2d4a-4935-961f-457a74bb5968", "name": "network-vif-deleted", "tag": "e0b8f928-6ade-4cf9-9fdc-8a8cb040d865"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:23:54.512665 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-72824904-914c-4e67-83d8-81edf14b1aa2 req-653fe98a-bf9e-4f10-aa8b-6aa4644de9bd service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:54.513104 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-72824904-914c-4e67-83d8-81edf14b1aa2 req-653fe98a-bf9e-4f10-aa8b-6aa4644de9bd service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:54.524181 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-72824904-914c-4e67-83d8-81edf14b1aa2 req-653fe98a-bf9e-4f10-aa8b-6aa4644de9bd service nova] Creating event network-vif-deleted:e0b8f928-6ade-4cf9-9fdc-8a8cb040d865 for instance a1d86f9d-2d4a-4935-961f-457a74bb5968 on hv-cinder-81045 Jun 22 17:23:54.528946 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-72824904-914c-4e67-83d8-81edf14b1aa2 req-653fe98a-bf9e-4f10-aa8b-6aa4644de9bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028626 Jun 22 17:23:54.529536 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 607/1184] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:23:55.444635 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:23:55.445254 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:23:55.451670 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:55.452149 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:55.452929 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:55.453374 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:55.485904 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:55.486356 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:55.486801 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lazy-loading 'fault' on Instance uuid a1d86f9d-2d4a-4935-961f-457a74bb5968 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:23:55.526725 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:23:55.534130 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-973a39c9-7c72-4bdc-9748-fcf8eec1dee9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 200 len: 1230 microversion: 2.1 time: 0.093409 Jun 22 17:23:55.534691 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 578/1185] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:23:55 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:23:56.553488 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:23:56.554307 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: a1d86f9d-2d4a-4935-961f-457a74bb5968] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:23:56.561160 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:56.561605 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:56.562352 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:56.562781 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:56.575688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] HTTP exception thrown: Instance a1d86f9d-2d4a-4935-961f-457a74bb5968 could not be found. Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Request method failure captured: Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 HTTP/1.1 Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis05Z6fM7NgNaZNxDFbU86eetYkXg0GDCwBsv4R89yLXE2B6YT0if3ruX_fCdUr7io7GvJNJBBe9krOzUGcrXRzQ58ghiGHc8qg1qZoFYjOJ8mHGYM28PT5q3mDNc6NV6QCfWGnGaKWcnkypBk-kUxj-VfxYsvUhazUX3ZhALwRSRC-M Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:23:56.581490 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 00da4e0bbeba4a1f954ea2d27ff18f59 Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance a1d86f9d-2d4a-4935-961f-457a74bb5968 could not be found. Jun 22 17:23:56.583362 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': 'a1d86f9d-2d4a-4935-961f-457a74bb5968'} Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d86f9d-2d4a-4935-961f-457a74bb5968 could not be found. Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:23:56.584308 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d86f9d-2d4a-4935-961f-457a74bb5968 could not be found. Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d86f9d-2d4a-4935-961f-457a74bb5968 could not be found. Jun 22 17:23:56.586425 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:23:56.587843 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Returning 404 to user: Instance a1d86f9d-2d4a-4935-961f-457a74bb5968 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:23:56.587843 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-20000219-79d9-441c-849c-48d912325ee6 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968" status: 404 len: 111 microversion: 2.1 time: 0.030759 Jun 22 17:23:56.587843 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 608/1186] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:23:56 2022] GET /compute/v2.1/servers/a1d86f9d-2d4a-4935-961f-457a74bb5968 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:23:59.892043 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bf2520be-7f54-4fae-ba0a-edf3fb5e41a2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:23:59.892595 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bf2520be-7f54-4fae-ba0a-edf3fb5e41a2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:23:59.894116 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [req-c929c4ab-ccb2-4b00-b178-91a4f8eafbaf req-4ad0e00e-7f68-4be7-a2b9-93abad413ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72295916-5bcf-49bd-84c7-499d248adff4", "tag": "81294489-c100-4e84-b180-78dfc6cf2164"}]} {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:23:59.900352 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bf2520be-7f54-4fae-ba0a-edf3fb5e41a2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:59.900798 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bf2520be-7f54-4fae-ba0a-edf3fb5e41a2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:59.901600 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bf2520be-7f54-4fae-ba0a-edf3fb5e41a2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:59.902032 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bf2520be-7f54-4fae-ba0a-edf3fb5e41a2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:59.904293 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-c929c4ab-ccb2-4b00-b178-91a4f8eafbaf req-4ad0e00e-7f68-4be7-a2b9-93abad413ae4 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:23:59.904806 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [req-c929c4ab-ccb2-4b00-b178-91a4f8eafbaf req-4ad0e00e-7f68-4be7-a2b9-93abad413ae4 service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:23:59.917301 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.compute.server_external_events [req-c929c4ab-ccb2-4b00-b178-91a4f8eafbaf req-4ad0e00e-7f68-4be7-a2b9-93abad413ae4 service nova] Creating event network-changed:81294489-c100-4e84-b180-78dfc6cf2164 for instance 72295916-5bcf-49bd-84c7-499d248adff4 on hv-cinder-81045 Jun 22 17:23:59.924783 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [req-c929c4ab-ccb2-4b00-b178-91a4f8eafbaf req-4ad0e00e-7f68-4be7-a2b9-93abad413ae4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034226 Jun 22 17:23:59.938206 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 609/1187] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:23:59.938783 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bf2520be-7f54-4fae-ba0a-edf3fb5e41a2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 17:24:00.077638 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:24:00.078152 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:24:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:24:00.391930 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:24:00.392229 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:24:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 (ip 10.222.0.18) !!! Jun 22 17:24:00.413661 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bf2520be-7f54-4fae-ba0a-edf3fb5e41a2 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 204 len: 0 microversion: 2.1 time: 0.526006 Jun 22 17:24:00.414246 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 579/1188] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:23:59 2022] DELETE /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 17:24:00.422833 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-06f72ba9-5e70-4b57-812d-b37931c555f9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:24:00.423804 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-06f72ba9-5e70-4b57-812d-b37931c555f9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:24:00.430495 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-06f72ba9-5e70-4b57-812d-b37931c555f9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:00.430951 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-06f72ba9-5e70-4b57-812d-b37931c555f9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:00.431725 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-06f72ba9-5e70-4b57-812d-b37931c555f9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:00.432183 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-06f72ba9-5e70-4b57-812d-b37931c555f9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:00.569109 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-06f72ba9-5e70-4b57-812d-b37931c555f9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:24:00.577007 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-06f72ba9-5e70-4b57-812d-b37931c555f9 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1575 microversion: 2.1 time: 0.158145 Jun 22 17:24:00.577577 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 610/1189] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:24:00 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 17:24:01.594946 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-da1ab1fa-78df-4bf3-97dc-ba2927c75e94 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:24:01.595649 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-da1ab1fa-78df-4bf3-97dc-ba2927c75e94 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:24:01.602881 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-da1ab1fa-78df-4bf3-97dc-ba2927c75e94 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:01.603330 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-da1ab1fa-78df-4bf3-97dc-ba2927c75e94 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:01.604078 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-da1ab1fa-78df-4bf3-97dc-ba2927c75e94 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:01.604542 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-da1ab1fa-78df-4bf3-97dc-ba2927c75e94 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:01.738228 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-da1ab1fa-78df-4bf3-97dc-ba2927c75e94 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:24:01.745822 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-da1ab1fa-78df-4bf3-97dc-ba2927c75e94 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1456 microversion: 2.1 time: 0.155171 Jun 22 17:24:01.746377 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 580/1190] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:24:01 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1456 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:24:02.762794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-bc1e4fa6-28e1-4330-ba70-3c919085f64b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:24:02.763405 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-bc1e4fa6-28e1-4330-ba70-3c919085f64b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:24:02.764057 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-1ec832ac-74a4-4fc6-9885-a9f2c163d864 req-2c69baaf-c2b0-4e3b-8748-0dcd48f02eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72295916-5bcf-49bd-84c7-499d248adff4", "name": "network-vif-deleted", "tag": "81294489-c100-4e84-b180-78dfc6cf2164"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 17:24:02.770449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bc1e4fa6-28e1-4330-ba70-3c919085f64b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:02.770893 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bc1e4fa6-28e1-4330-ba70-3c919085f64b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:02.771842 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bc1e4fa6-28e1-4330-ba70-3c919085f64b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:02.772549 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-bc1e4fa6-28e1-4330-ba70-3c919085f64b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:02.773597 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1ec832ac-74a4-4fc6-9885-a9f2c163d864 req-2c69baaf-c2b0-4e3b-8748-0dcd48f02eae service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:02.789238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-1ec832ac-74a4-4fc6-9885-a9f2c163d864 req-2c69baaf-c2b0-4e3b-8748-0dcd48f02eae service nova] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:02.789238 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-1ec832ac-74a4-4fc6-9885-a9f2c163d864 req-2c69baaf-c2b0-4e3b-8748-0dcd48f02eae service nova] Creating event network-vif-deleted:81294489-c100-4e84-b180-78dfc6cf2164 for instance 72295916-5bcf-49bd-84c7-499d248adff4 on hv-cinder-81045 Jun 22 17:24:02.791616 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-1ec832ac-74a4-4fc6-9885-a9f2c163d864 req-2c69baaf-c2b0-4e3b-8748-0dcd48f02eae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031103 Jun 22 17:24:02.794129 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 581/1191] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 17:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 17:24:02.841677 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.policy [None req-bc1e4fa6-28e1-4330-ba70-3c919085f64b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:24:02.849720 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-bc1e4fa6-28e1-4330-ba70-3c919085f64b tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1389 microversion: 2.1 time: 0.090852 Jun 22 17:24:02.850268 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 611/1192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:24:02 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:24:03.867559 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:24:03.868285 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:24:03.874382 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:03.874832 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:03.875654 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:03.876091 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:03.906931 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:03.907371 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:03.907815 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lazy-loading 'fault' on Instance uuid 72295916-5bcf-49bd-84c7-499d248adff4 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 17:24:03.951827 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00da4e0bbeba4a1f954ea2d27ff18f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c32a4df73e946b2844051778a16a8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 17:24:03.960032 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-259ebd4a-1cba-4b0b-bb51-bb6755adf05f tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 200 len: 1230 microversion: 2.1 time: 0.097031 Jun 22 17:24:03.966069 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 582/1193] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:24:03 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 17:24:04.977187 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:24:04.977794 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 72295916-5bcf-49bd-84c7-499d248adff4] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:24:04.984375 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:04.984820 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:04.985580 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:04.986011 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:04.999340 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] HTTP exception thrown: Instance 72295916-5bcf-49bd-84c7-499d248adff4 could not be found. Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Request method failure captured: Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 HTTP/1.1 Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis05Z6fM7NgNaZNxDFbU86eetYkXg0GDCwBsv4R89yLXE2B6YT0if3ruX_fCdUr7io7GvJNJBBe9krOzUGcrXRzQ58ghiGHc8qg1qZoFYjOJ8mHGYM28PT5q3mDNc6NV6QCfWGnGaKWcnkypBk-kUxj-VfxYsvUhazUX3ZhALwRSRC-M Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:24:05.000987 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 00da4e0bbeba4a1f954ea2d27ff18f59 Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 72295916-5bcf-49bd-84c7-499d248adff4 could not be found. Jun 22 17:24:05.002913 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '72295916-5bcf-49bd-84c7-499d248adff4'} Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72295916-5bcf-49bd-84c7-499d248adff4 could not be found. Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:24:05.004148 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72295916-5bcf-49bd-84c7-499d248adff4 could not be found. Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72295916-5bcf-49bd-84c7-499d248adff4 could not be found. Jun 22 17:24:05.006769 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.008857 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Returning 404 to user: Instance 72295916-5bcf-49bd-84c7-499d248adff4 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:24:05.008857 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-c2127f8c-ecc4-4e2c-a534-c45692728a30 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4" status: 404 len: 111 microversion: 2.1 time: 0.029165 Jun 22 17:24:05.008857 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 612/1194] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:24:04 2022] GET /compute/v2.1/servers/72295916-5bcf-49bd-84c7-499d248adff4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:24:05.493127 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:24:05.502267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:24:05.502267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:05.502267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:05.502267 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:05.502683 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:05.514828 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] HTTP exception thrown: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Request method failure captured: Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 HTTP/1.1 Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Connection: close Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Host: 10.222.0.18 Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABis05Z6fM7NgNaZNxDFbU86eetYkXg0GDCwBsv4R89yLXE2B6YT0if3ruX_fCdUr7io7GvJNJBBe9krOzUGcrXRzQ58ghiGHc8qg1qZoFYjOJ8mHGYM28PT5q3mDNc6NV6QCfWGnGaKWcnkypBk-kUxj-VfxYsvUhazUX3ZhALwRSRC-M Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Role: reader,member Jun 22 17:24:05.516507 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Roles: reader,member Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Id: 00da4e0bbeba4a1f954ea2d27ff18f59 Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: method: > Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: exception: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.518289 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: action_args: {'id': '8000b1a5-9448-4b4b-bc6b-3006352c7796'} Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:24:05.519273 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.520987 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.522621 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Returning 404 to user: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:24:05.522621 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a847002b-91ad-4b71-8730-7c128aa5e384 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 404 len: 111 microversion: 2.1 time: 0.029296 Jun 22 17:24:05.522621 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 583/1195] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 17:24:05 2022] DELETE /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 17:24:05.526495 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '>' {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:24:05.527109 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.compute.api [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] [instance: 8000b1a5-9448-4b4b-bc6b-3006352c7796] Fetching instance by UUID {{(pid=118471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 17:24:05.533031 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:05.533474 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:05.534223 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 17:24:05.534652 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG oslo_concurrency.lockutils [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Lock "889b0550-a155-4c00-a285-69151626d4f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 17:24:05.550558 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.wsgi [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] HTTP exception thrown: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Request method failure captured: Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: request: GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 HTTP/1.1 Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept: application/json Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Accept-Encoding: identity Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Connection: close Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Length: 0 Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Content-Type: application/json Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Host: 10.222.0.18 Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Openstack-System-Scope: None Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: User-Agent: python-urllib3/1.26.9 Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Auth-Token: gAAAAABis05Z6fM7NgNaZNxDFbU86eetYkXg0GDCwBsv4R89yLXE2B6YT0if3ruX_fCdUr7io7GvJNJBBe9krOzUGcrXRzQ58ghiGHc8qg1qZoFYjOJ8mHGYM28PT5q3mDNc6NV6QCfWGnGaKWcnkypBk-kUxj-VfxYsvUhazUX3ZhALwRSRC-M Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Id: None Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Domain-Name: None Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Identity-Status: Confirmed Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Is-Admin-Project: True Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Id: default Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Domain-Name: Default Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Project-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Role: reader,member Jun 22 17:24:05.552688 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Roles: reader,member Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c32a4df73e946b2844051778a16a8c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Id: 2c32a4df73e946b2844051778a16a8c0 Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-Tenant-Name: tempest-TestVolumeBootPattern-1330615387 Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Id: default Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Domain-Name: Default Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Id: 00da4e0bbeba4a1f954ea2d27ff18f59 Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: X-User-Name: tempest-TestVolumeBootPattern-1330615387-project Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: method: > Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: exception: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.554449 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: action_args: {'id': '8000b1a5-9448-4b4b-bc6b-3006352c7796'} Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: {{(pid=118471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 17:24:05.555339 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. Jun 22 17:24:05.556759 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: ERROR nova.api.openstack.wsgi Jun 22 17:24:05.558158 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: DEBUG nova.api.openstack.wsgi [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Returning 404 to user: Instance 8000b1a5-9448-4b4b-bc6b-3006352c7796 could not be found. {{(pid=118471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 17:24:05.558158 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO nova.api.openstack.requestlog [None req-eec433be-91ef-4f85-9fbd-c5c5171d97d8 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796" status: 404 len: 111 microversion: 2.1 time: 0.031412 Jun 22 17:24:05.558158 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: [pid: 118471|app: 0|req: 613/1196] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 17:24:05 2022] GET /compute/v2.1/servers/8000b1a5-9448-4b4b-bc6b-3006352c7796 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 17:24:07.139802 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ec79210f-8eb7-4821-ae69-2be98e2233c5 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] Calling method '.version_select at 0x7fe0a05f7ee0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 17:24:07.227242 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ec79210f-8eb7-4821-ae69-2be98e2233c5 tempest-TestVolumeBootPattern-1330615387 tempest-TestVolumeBootPattern-1330615387-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-119335214" status: 202 len: 0 microversion: 2.1 time: 0.091221 Jun 22 17:24:07.227832 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 584/1197] 10.222.0.18 () {58 vars in 1259 bytes} [Wed Jun 22 17:24:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-119335214 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 17:24:18.220873 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:24:18.221457 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:27:20.088822 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:27:20.089441 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:27:20.400943 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:27:20.401453 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:27:38.230388 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:27:38.231002 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:29:14.437837 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:29:14.438439 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:29:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:29:15.709299 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:29:15.709844 dv-cinder-810457-10-iscsi devstack@n-api.service[118471]: Wed Jun 22 17:29:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 17:29:29.992394 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 17:29:29.993031 dv-cinder-810457-10-iscsi devstack@n-api.service[118472]: Wed Jun 22 17:29:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!